-- Logs begin at Wed 2022-08-24 08:35:12 UTC, end at Wed 2022-08-24 10:29:10 UTC. -- Aug 24 09:18:46.459098 dv-cinder-850321-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 09:18:46.468825 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 09:18:46 2022] *** Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: nodename: dv-cinder-850321-5-iscsi Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: machine: x86_64 Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: clock source: unix Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: pcre jit disabled Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: detected number of CPU cores: 4 Aug 24 09:18:46.470784 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: current working directory: / Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: detected binary path: /usr/bin/uwsgi-core Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: your processes number limit is 47680 Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: your memory page size is 4096 bytes Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: detected max file descriptor number: 2048 Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: lock engine: pthread robust mutexes Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: thunder lock: enabled Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 09:18:46.471408 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 09:18:46.510598 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: Python main interpreter initialized at 0x560add2b09c0 Aug 24 09:18:46.510598 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: python threads support enabled Aug 24 09:18:46.510598 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: your server socket listen backlog is limited to 100 connections Aug 24 09:18:46.510598 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: your mercy for graceful operations on workers is 90 seconds Aug 24 09:18:46.510938 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 09:18:46.511017 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: *** Operational MODE: preforking *** Aug 24 09:18:46.511260 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: *** uWSGI is running in multiple interpreter mode *** Aug 24 09:18:46.511260 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: spawned uWSGI master process (pid: 105922) Aug 24 09:18:46.511453 dv-cinder-850321-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 09:18:46.515010 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: spawned uWSGI worker 1 (pid: 105923, cores: 1) Aug 24 09:18:46.515010 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: spawned uWSGI worker 2 (pid: 105924, cores: 1) Aug 24 09:18:46.515010 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 09:18:47.173358 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 09:18:47.173965 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 09:18:48.257465 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:18:48.257465 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: from cryptography.utils import int_from_bytes Aug 24 09:18:48.258099 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:18:48.258099 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: from cryptography.utils import int_from_bytes Aug 24 09:18:48.258904 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:18:48.258904 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: from cryptography.utils import int_from_bytes Aug 24 09:18:48.259336 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:18:48.259336 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: from cryptography.utils import int_from_bytes Aug 24 09:18:50.740007 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:18:50.740551 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:18:50.740689 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:18:50.741045 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:18:50.741256 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:18:50.741660 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:18:50.741758 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:18:50.741840 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.741979 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.742089 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:18:50.742296 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.742403 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:18:50.742594 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:18:50.742689 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.742924 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.743010 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.743231 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.743342 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.743549 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.743684 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.743887 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.743976 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.744208 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.744298 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.744466 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.744554 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.744779 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.744880 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.745100 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-5-iscsi {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.745205 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.745417 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.745505 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.745672 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.745769 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.745985 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.746081 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.746310 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-5-iscsi {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.746399 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.746603 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.746709 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.746905 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.746991 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.747209 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.747303 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.747520 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.747728 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.747833 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.748150 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.748268 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.748452 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.748545 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.748755 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.748948 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.749607 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.749775 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.749922 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.750057 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.750228 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.750362 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.750547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.750690 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.750853 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.750996 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.751175 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.751304 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.751483 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.751639 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.751901 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-5-iscsi {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.751992 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.752216 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.752315 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.752526 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.752621 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.752838 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.752934 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-5-iscsi {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.753213 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.753348 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.753520 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.753635 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.753830 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.753941 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.754141 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.754229 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.754460 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.754558 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.754764 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.754863 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.755082 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.755171 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.755395 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.755493 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.755721 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.755823 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.756038 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.756126 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.756336 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.756432 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.756644 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.756757 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.756950 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.757069 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.757262 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.757357 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.757565 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.757653 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.757863 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.757949 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.758107 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.758195 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.758411 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.758499 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.758726 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.758827 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.758973 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.759058 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.759277 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.759365 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.759577 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.759700 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.759847 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.759955 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.760162 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.760258 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.760445 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.760534 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.760693 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.760800 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.761005 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.761094 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.761322 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.761412 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.761626 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.761713 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.761926 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.762022 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.762222 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.762364 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.762521 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.762611 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.762820 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.762917 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.763121 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.763209 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.763422 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.763518 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.763745 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.763895 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.764057 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.764144 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.764364 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.764451 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.764705 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.765327 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.765539 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.765627 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.765852 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.765939 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.766184 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.766274 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.766473 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.766559 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.766779 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.766898 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.767091 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.767181 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.767412 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.767575 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.767779 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.767918 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.768068 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.768204 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.768342 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.768478 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.768615 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.768760 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.768918 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.769055 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.769193 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.769348 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.769487 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.769633 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.769779 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.769918 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.770055 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.770191 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.770327 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.770482 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.770628 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.770767 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.770904 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.771049 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.771196 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.772805 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.772951 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773039 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773167 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773252 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773332 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773426 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773552 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773645 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773726 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773805 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773883 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.773972 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774097 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774189 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774269 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774348 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774435 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774516 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774594 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774673 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774751 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774830 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.774921 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775013 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775094 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775173 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775252 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775449 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775548 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775831 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.775945 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.776130 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.776218 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.776431 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.776532 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.776729 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.776842 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.777032 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.777132 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.777327 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.777428 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.777733 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.777918 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.778153 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.778336 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.778458 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.778666 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.778757 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.778975 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.779076 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.779281 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.779369 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.779636 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.779792 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.779942 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.780084 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.780225 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.780315 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.780558 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.780701 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.780857 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.781002 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.781146 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.781291 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.781433 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.781570 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.781711 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.781844 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.782009 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.782155 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.782309 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.782480 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.782626 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.782762 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.782905 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.783056 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.783191 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.783330 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.783467 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.783633 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.783775 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.783924 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.784066 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.784211 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.784338 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.784425 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.784656 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.784744 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.784960 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.785087 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.785263 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.785360 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.785564 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.785659 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.785874 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:18:50.785970 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.786206 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.786294 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.786534 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.786623 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.786849 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.786935 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.787165 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.787275 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.787487 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.787574 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.787821 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.787908 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.788129 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.788231 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.788436 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.788522 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.788747 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.788841 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.789062 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.789165 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.789366 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.789452 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.789673 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.789761 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.789980 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.790082 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.790292 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.790406 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.790602 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.790691 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.790919 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.791017 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.791234 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.791321 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.791548 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.791713 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.791881 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.791987 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.792186 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.792273 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.792503 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.792631 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.792829 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.792918 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.793146 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.793233 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.793453 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.793540 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.793758 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.793858 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.794065 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.794159 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.794373 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.794469 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.794691 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.794781 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.795021 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.795114 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.795327 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.795414 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.795655 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.795748 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.796001 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.796089 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.796314 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.796413 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.796621 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.796709 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.796931 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.797019 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.797243 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.797352 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.797547 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.797642 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.797856 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.797944 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.798165 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.798266 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.798470 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.798557 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.798777 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.798864 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.799085 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.799180 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.799395 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.799483 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.799728 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.799829 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.800031 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.800127 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.800334 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.800423 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.800634 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.800722 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.800940 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.801035 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.801237 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.801325 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.801545 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.801631 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.801845 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.801934 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.802147 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.802243 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.802452 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.802541 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.802753 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.802842 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.803055 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.803141 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.803363 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.803452 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.803695 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.803790 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.803999 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.804089 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.804308 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.804453 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.804614 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.804702 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.804913 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.805001 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.805216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.805310 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.805520 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.805609 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.805818 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.805905 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.806122 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.806221 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.806422 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.806517 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.806717 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.806804 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.807026 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.807123 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.807326 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.807452 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.807657 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.807770 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.807959 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.808058 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.808259 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.808361 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.808568 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.808666 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.808873 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.808970 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.809178 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.809273 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.809483 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.809585 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.809792 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.809896 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.810105 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.810192 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.810412 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.810506 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.810722 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.810812 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.811029 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.811115 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.811329 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.811430 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.812177 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.812274 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.812485 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.812586 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.812789 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.812892 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.813094 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.813204 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.813389 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.813473 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.813691 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.813831 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.813989 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.814284 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.814375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.814581 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.814675 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.814884 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.814974 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.815179 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.815274 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.815479 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.815679 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.815805 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.815902 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.816106 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.816195 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.816411 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.816570 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.816709 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.816847 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.817015 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.817152 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.817317 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.817539 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.817678 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.817813 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.817947 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.818096 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.818232 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.818377 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.818512 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.818646 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.818842 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.818997 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.819172 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.819311 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.819485 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.819679 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.819826 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.819913 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.820136 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.820227 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.820444 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.820530 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.820751 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.820902 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.821062 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.821152 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.821377 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.821464 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.821683 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.821770 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.821999 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.822100 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.822306 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.822393 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.822621 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.822715 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.822923 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.823011 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.823236 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.823324 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.823541 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.823672 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.823885 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.823987 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.824186 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.824280 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.824498 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.824652 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.824834 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.824928 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.825147 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.825236 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.825457 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.825555 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.825769 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.825858 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.826078 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.826164 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.826386 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.826483 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.826689 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.826776 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.826999 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.827085 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.827889 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.828013 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.828208 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.828306 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.828528 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.828626 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.828836 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.828932 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.829152 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.829247 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.829454 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.829551 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.829768 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.829867 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.830070 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.830165 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.830389 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.830486 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.830789 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.830998 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.831097 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.831315 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.831421 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.831652 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.831751 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.831960 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.832047 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.832266 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.832382 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.832571 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.832667 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.832871 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.832973 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.833179 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.833292 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.833480 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.833567 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.833783 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.833916 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.834086 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.834182 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.834386 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.834481 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.834695 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.834846 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.834997 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.835132 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.835269 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.835415 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.835559 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.835681 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.835890 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.835991 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.836191 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.836277 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.836744 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.836833 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.837045 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.837134 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.837352 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.837439 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.837656 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.837749 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.837973 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.838108 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.838270 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.838358 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.838572 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.838658 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.838873 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.838969 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.839167 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.839261 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.839465 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.839560 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.839799 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.839889 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.840101 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.840190 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.840401 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.840501 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.840701 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.840796 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.841013 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.841099 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.841318 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.841414 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.841620 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.841706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.841921 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.842008 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.842226 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.842323 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.842527 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.842614 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.842857 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.842951 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.843161 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.843299 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.843465 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.843552 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.843798 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.843887 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.844104 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.844203 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.844408 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.844496 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.844711 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.844841 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.845019 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.845108 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.845322 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.845411 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.845625 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.845713 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.845925 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.846014 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.846227 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.846312 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.846533 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.846629 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.846841 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.847098 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.847187 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.847429 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.847516 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.847765 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.847857 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.848083 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.848324 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.848416 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.848651 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.848747 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.848962 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.849058 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.849273 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.849361 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.849588 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.849685 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.849904 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.850001 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.850228 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.850315 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.850530 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.850619 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.850830 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.850919 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.851137 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.851235 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.851439 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.851528 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.851763 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.851866 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.852061 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.852156 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.852363 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.852450 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.852660 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.852756 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.852956 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.853049 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.853250 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.853374 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.853551 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.853641 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.853846 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.853967 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.854143 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.854233 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.854436 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.854524 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.854733 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.854829 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.855037 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.855126 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.855336 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.855433 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.855655 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.855746 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.855954 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.856040 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.856249 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.856338 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.856558 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.856651 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.856857 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.856954 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.857156 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.857243 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.857455 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.857542 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.857789 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.857891 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.858088 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.858176 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.858908 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.859012 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.859254 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.859354 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.859604 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.859696 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.859917 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.860125 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.860232 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.860438 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.860549 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.860748 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.860837 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.861057 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.861156 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.861358 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.861447 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.861667 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.861754 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.861974 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.862076 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.862281 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.862369 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.862603 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.862731 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.862882 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.862983 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.863183 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.863271 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.863479 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.863572 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.863800 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.863901 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.864104 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.864192 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.864402 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.864489 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.864701 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.864790 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.864999 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.865093 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.865298 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.865387 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.865593 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.865682 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.865894 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.865982 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.866193 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.866288 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.866487 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.866575 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.866790 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.866876 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.867084 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.867171 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.867385 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.867473 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.867710 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.867801 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.868011 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.868115 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.868306 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.868438 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.868607 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.868694 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.868910 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.869071 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.869207 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.869301 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.869509 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.869605 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.869814 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.869909 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.870111 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.870198 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.870406 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.870493 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.870709 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.870810 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.871006 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.871092 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.871311 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.871406 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.871628 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.871718 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.871939 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.872028 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.872239 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.872328 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.872534 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.872622 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.872830 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.872960 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.873125 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.873213 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.873420 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.873507 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.873716 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.873804 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.874011 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.874140 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.874360 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.874450 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.874655 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.874751 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.874969 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.875070 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.875275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.875372 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.875573 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.875687 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.875897 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.875998 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.876197 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.876284 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.876493 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.876579 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.876794 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.876896 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.877092 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.877187 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.877428 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.877516 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.877726 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.877822 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.878045 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.878133 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.878353 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.878479 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.878660 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.878748 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.878965 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.879052 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.879264 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.879352 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.879569 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.879702 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.879897 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.879986 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.880197 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.880284 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.880494 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.880583 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.880796 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.880884 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.881100 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.881187 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.881404 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.881493 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.881703 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.881791 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.882016 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.882112 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.882321 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.882407 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.882627 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.882721 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.882925 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.883029 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.883228 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.883316 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.883535 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.883662 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.883859 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.883966 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.884162 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.884251 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.884462 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.884548 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.884760 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.884859 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.885061 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.885149 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.885361 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.885452 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.885664 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.885761 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.885967 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.886054 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.886265 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.886361 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.886567 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.886655 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.886867 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.886955 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.887162 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.887249 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.887464 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.887553 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.887792 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.887882 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.888091 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.888189 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.888396 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.888493 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.888696 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.888792 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.888993 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.889094 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.889289 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.889378 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.889584 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.890218 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.890420 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.890523 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.890720 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.890830 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.891132 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.891233 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.891442 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.891544 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.891772 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.891861 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.892072 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.892159 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.892378 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.892475 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.892677 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.892772 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.892984 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.893091 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.893292 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.893388 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.893591 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.893679 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.893987 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.894083 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.894286 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.894383 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.894585 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.894675 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.894889 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.894976 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.895187 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.895276 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.895482 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.895621 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.895805 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.895901 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.896104 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.896194 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.896405 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.896504 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.896702 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.896803 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.896998 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.897086 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.897311 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.897398 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.897608 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.897772 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.897920 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.898008 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.898326 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.898414 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.898630 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.898727 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.898928 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.899017 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.899268 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.899354 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.899603 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.899746 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.899925 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.900015 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.900226 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.900314 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.900535 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.900631 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.900838 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.900945 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.901133 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.901221 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.901446 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.901541 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.901747 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.901845 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.902055 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.902144 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.902355 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.902444 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.902659 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.902748 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.902968 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.903058 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.903266 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.903363 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.903600 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.903703 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.903916 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.904005 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.904224 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.904312 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.904537 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.904633 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.904914 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.905010 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.905236 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.905376 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.905588 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.905681 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.905892 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.905983 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.906202 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.906301 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.906504 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.906593 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.906802 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.906888 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.907113 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.907211 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.907416 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.907505 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.907741 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.907831 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.908048 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.908217 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.908349 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.908437 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.908645 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.908734 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.908945 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.909042 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.909247 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.909334 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.909545 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.909632 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.909840 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.909928 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.910156 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.910244 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.910456 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.910545 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.910759 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.910849 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.911058 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.911146 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.911373 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.911463 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.911700 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.911792 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912002 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912089 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912302 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912403 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912601 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912690 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912897 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.912983 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.913195 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.913295 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.913514 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.913610 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.913830 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.913918 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.914130 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.914230 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.914443 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.914538 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.914764 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.914851 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.915082 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.915178 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.915382 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.915468 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.915727 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.915829 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.916046 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.916134 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.916344 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.916440 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.916644 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.916734 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.916950 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.917040 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.917246 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.917340 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.917543 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.917634 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.917838 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.917933 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.918132 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.918262 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.918429 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.918529 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.918724 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.918824 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.919018 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.919109 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.919310 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.919408 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.919627 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.919731 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.919931 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.920018 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.920238 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.920335 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.920535 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.920622 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.920834 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.921432 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.921649 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.921747 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.921952 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.922047 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.922251 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.922339 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.922551 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.922649 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.922872 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.922960 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.923169 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.923264 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.923487 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.923602 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.923812 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.923900 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.924121 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.924208 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.924430 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.924525 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.924737 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.924825 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.925044 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.925139 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.925351 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.925440 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.925655 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.925743 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.925963 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.926059 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.926273 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.926362 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.926575 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.926670 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.926888 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.927092 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.927183 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.927428 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.927516 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.927773 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.928021 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.928122 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.928349 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.928437 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.928658 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.928746 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.928967 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.929063 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.929274 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.929363 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.929584 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.929671 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.929891 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.929988 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.930195 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.930282 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.930501 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.930596 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.930807 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.930896 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.931113 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.931201 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.931437 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.931524 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.931782 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.931873 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.932098 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.932185 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.932411 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.932513 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.932725 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.932822 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.933034 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.933121 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.933344 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.933481 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.933653 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.933740 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.933964 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.934059 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.934276 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.934366 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.934582 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.934714 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.934889 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.934977 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.935195 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.935283 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.935504 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.935642 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.935838 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.935935 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.936146 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.936236 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.936451 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.936555 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.937302 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.937467 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.937612 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.937699 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.937917 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.938005 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.938227 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.938325 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.938537 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.938628 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.938851 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.938938 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.939163 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.939266 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.939474 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.939574 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.939808 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.940015 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.940116 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.940329 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.940418 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.940658 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.940911 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.941000 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.941221 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.941312 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.941549 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.941636 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.941876 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.941971 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.942197 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.942288 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.942499 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.942587 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.942804 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.942894 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.943113 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.943204 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.943410 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.943498 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.943735 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.943850 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.944041 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.944130 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.944346 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.944435 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.944644 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.944737 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.944957 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.945052 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.945261 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.945347 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.945561 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.945786 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.945914 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.946129 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.946217 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.946441 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.946674 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.946775 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.947016 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.947111 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.947327 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.947416 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.947667 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.947759 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.947989 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.948077 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.948288 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.948374 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.948588 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.948677 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.948898 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.948984 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.949198 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.949285 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.949497 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.949586 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.949799 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.949887 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.950101 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.950188 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.950403 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.950492 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.950701 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.950789 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.951012 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.951109 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.951414 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.951678 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.951772 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.952009 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.952096 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.952346 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.952438 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.952654 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.952749 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.952963 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.953051 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.953265 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.953359 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.953566 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.953692 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.953871 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.953990 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.954181 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.954293 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.954483 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.954603 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.954783 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.954904 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.955086 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.955283 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.955371 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.955600 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.955691 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.955920 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.956055 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.956223 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.956330 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.956531 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.956621 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.956832 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.956922 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.957150 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.957238 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.957452 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.957539 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.957754 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.957843 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.958073 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.958161 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.958375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.958505 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.958728 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.958940 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.959206 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.959331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.959552 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.959765 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.959923 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.960238 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.960327 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.960771 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.960867 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.961105 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.961662 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.961756 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.961993 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.962291 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.962380 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.962641 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.962884 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.962977 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.963200 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.963519 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.963867 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.963958 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.964174 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.964486 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.964582 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.964790 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.965080 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.965169 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.965388 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.965695 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.965790 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.965999 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.966306 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.966397 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.966614 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.966890 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.966987 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.967213 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.967449 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.967538 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.967863 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.968089 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.968178 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.968503 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.968690 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.968823 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.969140 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.969254 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.969453 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.969770 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.969859 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.970077 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.970382 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.970469 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.970688 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.970968 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.971058 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.971297 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.971539 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.971649 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.971946 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.972169 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.972265 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.972647 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.972743 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.972959 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.973278 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.973367 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.973598 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.973862 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.973958 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.974207 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.974448 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.974538 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.974820 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.975019 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.975137 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.975446 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.975632 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.975800 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.976136 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.976279 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.976461 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.976758 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.976849 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.977510 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.977621 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.977720 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.977803 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.977898 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.978046 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.978143 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.978361 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.978534 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.978666 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.978862 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.978951 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.979192 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.979282 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.979510 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.979661 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.979852 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.979942 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.980150 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.980237 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.980450 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.980549 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.980749 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.980847 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.981055 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.981152 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.981354 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.981444 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.981652 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.981742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.981952 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.982091 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.982249 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.982406 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.982548 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.982728 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.982832 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.983050 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.983153 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.983361 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.984017 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.984227 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.984316 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.984543 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.984644 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.984846 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.984944 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.985146 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.985244 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.985459 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.985549 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.985787 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.985877 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.986092 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.986179 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.986412 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.986516 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.986719 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.986817 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.987034 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.987121 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.987337 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.987427 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.987667 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.987777 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.987978 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.988081 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.988294 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.988381 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.988600 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.988686 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.988901 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.988999 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.989201 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.989289 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.989510 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.989637 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.989812 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.989980 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.990334 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.990428 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.990597 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.990843 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.990933 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.991220 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.991380 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.991546 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.991879 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.992002 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.992202 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.992518 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.992612 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.992837 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.993115 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.993203 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.993446 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.993679 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.993775 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.994065 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.994234 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.994374 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.994680 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.994810 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.994988 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.995297 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.995394 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.995635 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.995948 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.996047 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.996258 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.996519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.996608 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.996869 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.997098 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.997189 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.997504 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.997655 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.997811 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.998141 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.998229 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.998467 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.998786 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.998875 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.999156 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:50.999963 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.000057 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.000324 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.000584 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.000673 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.000938 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.001180 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.001269 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.001471 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105923) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:18:51.001778 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.002373 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.002974 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.003552 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.004182 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.004788 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.005382 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.005962 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.006583 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.007155 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.007850 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.008027 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.008536 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.008909 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.009235 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.009575 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.009911 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.010224 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.010553 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.010876 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.011202 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.011521 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.011878 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.012208 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.012520 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.012834 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.013145 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.013458 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.013768 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.014085 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.014394 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.015222 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.015542 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.015881 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.016209 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.016535 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.016843 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.017167 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.017492 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.017838 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.018151 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.018493 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.018819 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.019179 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.019576 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.019780 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:18:51.020024 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105924) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:18:51.153472 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO dbcounter [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Registered counter for database nova_api Aug 24 09:18:51.171530 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO dbcounter [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Registered counter for database nova_api Aug 24 09:18:51.174007 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_db.sqlalchemy.engines [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.180552 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writer thread running {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.191811 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.198189 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writer thread running {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.237575 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.context [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),050771cb-a121-45a6-9902-2168b65adc50(cell1) {{(pid=105923) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 09:18:51.241526 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:18:51.241955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:18:51.243519 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:18:51.244283 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:18:51.244731 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:18:51.246713 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:18:51.248713 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO dbcounter [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Registered counter for database nova_cell0 Aug 24 09:18:51.252793 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.context [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),050771cb-a121-45a6-9902-2168b65adc50(cell1) {{(pid=105924) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 09:18:51.254107 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO dbcounter [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Registered counter for database nova_cell1 Aug 24 09:18:51.256649 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_concurrency.lockutils [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:18:51.257126 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_concurrency.lockutils [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:18:51.258683 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_concurrency.lockutils [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:18:51.259403 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_concurrency.lockutils [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:18:51.259869 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_concurrency.lockutils [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:18:51.261864 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_concurrency.lockutils [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105924) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:18:51.262002 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_db.sqlalchemy.engines [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.263913 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO dbcounter [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Registered counter for database nova_cell0 Aug 24 09:18:51.264152 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_db.sqlalchemy.engines [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.269174 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writer thread running {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.269415 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO dbcounter [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Registered counter for database nova_cell1 Aug 24 09:18:51.272050 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writer thread running {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.276376 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.278048 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.283995 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writer thread running {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.286694 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writer thread running {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.416718 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO dbcounter [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Registered counter for database nova_cell0 Aug 24 09:18:51.426466 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_db.sqlalchemy.engines [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105923) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.428159 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO dbcounter [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Registered counter for database nova_cell0 Aug 24 09:18:51.430930 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writer thread running {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.435297 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG oslo_db.sqlalchemy.engines [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105924) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:18:51.439773 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writer thread running {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:18:51.861782 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: WARNING keystonemiddleware.auth_token [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:18:51.869118 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: WARNING keystonemiddleware.auth_token [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:18:51.883346 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: WARNING keystonemiddleware.auth_token [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:18:51.891244 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: WARNING keystonemiddleware.auth_token [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:18:52.218975 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: WARNING keystonemiddleware.auth_token [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:18:52.224905 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: WARNING keystonemiddleware.auth_token [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:18:52.230135 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560add2b09c0 pid: 105923 (default app) Aug 24 09:18:52.232221 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:18:52.233455 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] 10.222.0.16 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001764 Aug 24 09:18:52.233871 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 788 bytes} [Wed Aug 24 09:18:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:18:52.237265 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: WARNING keystonemiddleware.auth_token [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:18:52.243235 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: WARNING keystonemiddleware.auth_token [None req-3a8dee43-8f74-4bfb-ba65-f1420d086486 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:18:52.248618 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560add2b09c0 pid: 105924 (default app) Aug 24 09:20:13.141807 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:13.142809 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 24 09:20:13.143205 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 2/2] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:13.155231 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writing DB stats nova_api:SELECT=3 {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:13.156744 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writing DB stats nova_cell0:SELECT=3 {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:13.157758 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writing DB stats nova_cell1:SELECT=3 {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:13.158521 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:14.053847 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-f31c92e9-1600-4dd4-a70a-73a7cb86b4f1 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:14.085431 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-f31c92e9-1600-4dd4-a70a-73a7cb86b4f1 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.935181 Aug 24 09:20:14.086083 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 1/3] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Aug 24 09:20:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:16.414706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:16.415642 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-c60a1efa-defc-4c92-86a5-a5fe63d0c5d7 None None] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001368 Aug 24 09:20:16.416360 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 3/4] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:16.868087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-4b213a20-6f1b-41c2-a5ca-cf3907960902 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0, "swap": 0, "disk": 1, "id": "c1", "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:16.898005 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:20:16.898005 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: warnings.warn(msg) Aug 24 09:20:16.977158 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-4b213a20-6f1b-41c2-a5ca-cf3907960902 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.553715 Aug 24 09:20:16.977906 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 2/5] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:16 2022] POST /compute/v2.1/flavors => generated 407 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:17.222858 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-1c89c9d0-acfe-4dba-80ca-ec9baed6dbf5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:17.227440 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:20:17.227440 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: warnings.warn(msg) Aug 24 09:20:17.230296 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_api:SELECT=3 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:17.231640 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_cell1:SELECT=3 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:17.232751 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_cell0:SELECT=3 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:17.233497 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:17.344076 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-1c89c9d0-acfe-4dba-80ca-ec9baed6dbf5 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.357285 Aug 24 09:20:17.344668 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 4/6] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Aug 24 09:20:16 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:19.749490 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-4b213a20-6f1b-41c2-a5ca-cf3907960902 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:19.750678 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-4b213a20-6f1b-41c2-a5ca-cf3907960902 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Aug 24 09:20:19.751199 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 3/7] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:20:20.433835 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-e52d0c6a-66aa-4a2b-954a-16bbf2305f4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:20.453536 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:20:20.453536 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: warnings.warn(msg) Aug 24 09:20:20.561410 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-e52d0c6a-66aa-4a2b-954a-16bbf2305f4d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.803887 Aug 24 09:20:20.562376 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 5/8] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:20.574371 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-3366732a-9205-406e-8e4e-37cc860b7701 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:20.577484 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:20:20.577484 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: warnings.warn(msg) Aug 24 09:20:20.678977 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-3366732a-9205-406e-8e4e-37cc860b7701 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108519 Aug 24 09:20:20.687604 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 4/9] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Aug 24 09:20:20 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:23.060089 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-e52d0c6a-66aa-4a2b-954a-16bbf2305f4d admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:23.061449 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-e52d0c6a-66aa-4a2b-954a-16bbf2305f4d admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001859 Aug 24 09:20:23.061846 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 6/10] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:23.454796 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-fb537344-4166-4c9a-9cfa-0acbaa7045e6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "disk": 10}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:23.558610 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-fb537344-4166-4c9a-9cfa-0acbaa7045e6 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.490641 Aug 24 09:20:23.559801 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 5/11] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 09:20:23.572037 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-3692b2a7-62e4-4ce1-9fff-d73e3eb6f6c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:23.659291 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-3692b2a7-62e4-4ce1-9fff-d73e3eb6f6c2 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090987 Aug 24 09:20:23.659910 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 7/12] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Aug 24 09:20:23 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:26.247151 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-fb537344-4166-4c9a-9cfa-0acbaa7045e6 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:26.248202 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-fb537344-4166-4c9a-9cfa-0acbaa7045e6 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001761 Aug 24 09:20:26.248604 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 6/13] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:26.689591 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-fbfd4f2f-b366-470a-b800-fc16a6431737 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "swap": 0}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:26.755558 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-fbfd4f2f-b366-470a-b800-fc16a6431737 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.500689 Aug 24 09:20:26.756453 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 8/14] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 09:20:26.768774 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-5b8b3186-0405-4b58-9632-67e888411c0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:26.849994 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-5b8b3186-0405-4b58-9632-67e888411c0f admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084879 Aug 24 09:20:26.851362 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 7/15] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Aug 24 09:20:26 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:20:29.215119 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-fbfd4f2f-b366-470a-b800-fc16a6431737 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:29.216166 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-fbfd4f2f-b366-470a-b800-fc16a6431737 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 24 09:20:29.216566 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 9/16] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:29.647333 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-89a8bf67-eff6-44cc-a2e8-46189955f5f1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "swap": 0, "vcpus": 4, "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4"}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:29.778330 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-89a8bf67-eff6-44cc-a2e8-46189955f5f1 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.555072 Aug 24 09:20:29.783621 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 8/17] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:29.791373 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-ff8ca35b-4217-497c-a70c-db8c8611219c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:29.885057 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-ff8ca35b-4217-497c-a70c-db8c8611219c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097205 Aug 24 09:20:29.905567 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 10/18] 10.222.0.16 () {64 vars in 1336 bytes} [Wed Aug 24 09:20:29 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:20:32.411224 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-89a8bf67-eff6-44cc-a2e8-46189955f5f1 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:32.413164 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-89a8bf67-eff6-44cc-a2e8-46189955f5f1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002657 Aug 24 09:20:32.413888 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 9/19] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:32 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:32.831748 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-0632377c-49ed-4c98-8b08-6245a354024c admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:32.880041 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-0632377c-49ed-4c98-8b08-6245a354024c admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458437 Aug 24 09:20:32.881536 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 11/20] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Aug 24 09:20:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:20:35.790503 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-89a8bf67-eff6-44cc-a2e8-46189955f5f1 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:35.792331 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-89a8bf67-eff6-44cc-a2e8-46189955f5f1 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002430 Aug 24 09:20:35.793330 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 10/21] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:36.203963 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-2497a9b5-e521-4936-9f9e-76c78513446a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "name": "m1.tiny", "id": "1"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:36.269504 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-2497a9b5-e521-4936-9f9e-76c78513446a admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.469515 Aug 24 09:20:36.270079 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 12/22] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:35 2022] POST /compute/v2.1/flavors => generated 402 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:36.282904 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-8b1242d3-c8b2-4f69-8c6e-70c174ac9729 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:36.358349 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-8b1242d3-c8b2-4f69-8c6e-70c174ac9729 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078962 Aug 24 09:20:36.358881 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 11/23] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Aug 24 09:20:36 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:38.745505 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-2497a9b5-e521-4936-9f9e-76c78513446a admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:38.746871 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-2497a9b5-e521-4936-9f9e-76c78513446a admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 24 09:20:38.747284 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:39.128943 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-60c6e394-a0ab-4a99-8dff-1bba30996c6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "swap": 0, "ram": 2048, "id": "2"}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:39.211278 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-60c6e394-a0ab-4a99-8dff-1bba30996c6c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.457401 Aug 24 09:20:39.211962 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 12/25] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:39.225342 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-e4f85517-2c8c-45d4-96fd-54497919d41c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:39.304025 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-e4f85517-2c8c-45d4-96fd-54497919d41c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082454 Aug 24 09:20:39.305229 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 14/26] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Aug 24 09:20:39 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:42.317412 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-60c6e394-a0ab-4a99-8dff-1bba30996c6c admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:42.319163 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-60c6e394-a0ab-4a99-8dff-1bba30996c6c admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002180 Aug 24 09:20:42.326031 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 13/27] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:42 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:42.771560 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-1a19c820-3f37-4a6f-bf7d-d22b68d0b24b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "id": "3", "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:42.851770 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-1a19c820-3f37-4a6f-bf7d-d22b68d0b24b admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.524709 Aug 24 09:20:42.852721 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 15/28] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 09:20:42.867351 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-eb08ca09-2c32-4f54-ba5c-27f290c3019d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:42.940957 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-eb08ca09-2c32-4f54-ba5c-27f290c3019d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.078994 Aug 24 09:20:42.941579 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 14/29] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Aug 24 09:20:42 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:45.339730 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-1a19c820-3f37-4a6f-bf7d-d22b68d0b24b admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:45.340737 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-1a19c820-3f37-4a6f-bf7d-d22b68d0b24b admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 24 09:20:45.341389 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 16/30] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:20:45.782133 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-772e1c28-30d7-4cf5-9215-afbd01c628ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4", "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:45.791060 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:20:45.846947 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-772e1c28-30d7-4cf5-9215-afbd01c628ef admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.499502 Aug 24 09:20:45.847714 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 15/31] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 09:20:45.860358 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-2d25bdb3-4842-4847-a319-d8516c192afe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:45.969558 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-2d25bdb3-4842-4847-a319-d8516c192afe admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112796 Aug 24 09:20:45.970061 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 17/32] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Aug 24 09:20:45 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:20:48.345751 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-772e1c28-30d7-4cf5-9215-afbd01c628ef admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:20:48.346758 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-772e1c28-30d7-4cf5-9215-afbd01c628ef admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Aug 24 09:20:48.347168 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 16/33] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:20:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:20:48.846188 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-115b77b3-1681-4e03-8c57-7c950b1374f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "os-flavor-access:is_public": true, "ram": 16384, "rxtx_factor": 1.0, "id": "5", "swap": 0, "disk": 160, "name": "m1.xlarge"}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:48.926549 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-115b77b3-1681-4e03-8c57-7c950b1374f9 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.572818 Aug 24 09:20:48.927373 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 18/34] 10.222.0.16 () {64 vars in 1283 bytes} [Wed Aug 24 09:20:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:20:48.939914 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-4a8f4ceb-be87-462c-a0bd-9e0850ef3287 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:20:49.017956 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-4a8f4ceb-be87-462c-a0bd-9e0850ef3287 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082031 Aug 24 09:20:49.019632 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 17/35] 10.222.0.16 () {64 vars in 1333 bytes} [Wed Aug 24 09:20:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:21:08.382334 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-115b77b3-1681-4e03-8c57-7c950b1374f9 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:08.383330 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-115b77b3-1681-4e03-8c57-7c950b1374f9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 09:21:08.383761 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 19/36] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:21:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:08.781771 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-c47be682-3d1d-446c-b44a-3217541e8dc3 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:08.800320 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-c47be682-3d1d-446c-b44a-3217541e8dc3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.409434 Aug 24 09:21:08.800858 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Aug 24 09:21:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:21:09.865170 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-115b77b3-1681-4e03-8c57-7c950b1374f9 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:09.866176 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-115b77b3-1681-4e03-8c57-7c950b1374f9 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 24 09:21:09.866577 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 20/38] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:10.387132 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-86073c7f-5d94-4032-bd73-df5513fb3a43 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:10.392845 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.wsgi [None req-86073c7f-5d94-4032-bd73-df5513fb3a43 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-86073c7f-5d94-4032-bd73-df5513fb3a43 admin admin] Request method failure captured: Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Accept: application/json Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Accept-Encoding: gzip, deflate Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Connection: keep-alive Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Content-Length: 0 Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Host: 10.222.0.16 Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Openstack-Api-Version: compute 2.90 Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Openstack-System-Scope: None Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: User-Agent: python-novaclient Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Auth-Token: gAAAAABjBe2ForhdqkTO32qk5nCSxB-gATmsJVzFVv4ZKFNq4lFkXL9l6HrujWMNUmmeiQI-UecF3ZvycAHB1C7bFOCZP43cXeLRTj1imUEtosQbjBSAvQ0k-bGkyxRTfQi9Mc63QZ9Tq1ceB-YVr3SfbJRzLY5hGOuJgGlJ7Rutj5-rdVVER0I Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Domain-Id: None Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Domain-Name: None Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Identity-Status: Confirmed Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Is-Admin-Project: True Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Domain-Id: default Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Domain-Name: Default Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Name: admin Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Role: member,admin,reader Aug 24 09:21:10.396077 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Roles: member,admin,reader Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e359feabfca34b0e8852e124e6b4b5a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant: admin Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant-Name: admin Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User: admin Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Domain-Id: default Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Domain-Name: Default Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Id: d1828412cb04465dbfa15b26582aa6de Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Name: admin Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: method: > Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: exception: Flavor 42 could not be found. Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: action_args: {'id': '42'} Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:21:10.397634 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:10.398519 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.399733 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-86073c7f-5d94-4032-bd73-df5513fb3a43 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:21:10.400847 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-86073c7f-5d94-4032-bd73-df5513fb3a43 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.394784 Aug 24 09:21:10.400847 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 19/39] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Aug 24 09:21:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 09:21:10.407077 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-fdf2fff1-af7f-4fb4-bfe7-3abfe4149910 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:10.411146 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:21:10.429780 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-fdf2fff1-af7f-4fb4-bfe7-3abfe4149910 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026218 Aug 24 09:21:10.430311 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 21/40] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Aug 24 09:21:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:21:10.440426 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-9ede3fbd-6f8c-44c6-8270-0cd26baa39f0 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:10.464651 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-9ede3fbd-6f8c-44c6-8270-0cd26baa39f0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027745 Aug 24 09:21:10.465228 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 20/41] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Aug 24 09:21:10 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:21:10.474563 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-03e2b195-5ed1-4b16-a8e9-ddbd6db884ab admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:10.480725 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.wsgi [None req-03e2b195-5ed1-4b16-a8e9-ddbd6db884ab admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-03e2b195-5ed1-4b16-a8e9-ddbd6db884ab admin admin] Request method failure captured: Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Accept: application/json Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Accept-Encoding: gzip, deflate Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Connection: keep-alive Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Content-Length: 0 Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Host: 10.222.0.16 Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Openstack-Api-Version: compute 2.90 Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Openstack-System-Scope: None Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: User-Agent: python-novaclient Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Auth-Token: gAAAAABjBe2ForhdqkTO32qk5nCSxB-gATmsJVzFVv4ZKFNq4lFkXL9l6HrujWMNUmmeiQI-UecF3ZvycAHB1C7bFOCZP43cXeLRTj1imUEtosQbjBSAvQ0k-bGkyxRTfQi9Mc63QZ9Tq1ceB-YVr3SfbJRzLY5hGOuJgGlJ7Rutj5-rdVVER0I Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Domain-Id: None Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Domain-Name: None Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Identity-Status: Confirmed Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Is-Admin-Project: True Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Domain-Id: default Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Domain-Name: Default Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Name: admin Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Role: member,admin,reader Aug 24 09:21:10.483982 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Roles: member,admin,reader Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e359feabfca34b0e8852e124e6b4b5a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant: admin Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant-Name: admin Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User: admin Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Domain-Id: default Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Domain-Name: Default Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Id: d1828412cb04465dbfa15b26582aa6de Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Name: admin Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: method: > Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: exception: Flavor 42 could not be found. Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: action_args: {'id': '42'} Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:21:10.485698 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:10.486706 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:10.490616 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-03e2b195-5ed1-4b16-a8e9-ddbd6db884ab admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:21:10.491987 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-03e2b195-5ed1-4b16-a8e9-ddbd6db884ab admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014464 Aug 24 09:21:10.491987 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 22/42] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Aug 24 09:21:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 09:21:11.454511 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-9ede3fbd-6f8c-44c6-8270-0cd26baa39f0 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:11.455516 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-9ede3fbd-6f8c-44c6-8270-0cd26baa39f0 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 09:21:11.455972 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 21/43] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:11.975951 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-a57bcd07-8f3a-4742-b89b-c70cc624fa27 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:11.981217 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.wsgi [None req-a57bcd07-8f3a-4742-b89b-c70cc624fa27 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-a57bcd07-8f3a-4742-b89b-c70cc624fa27 admin admin] Request method failure captured: Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Accept: application/json Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Accept-Encoding: gzip, deflate Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Connection: keep-alive Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Content-Length: 0 Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Host: 10.222.0.16 Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Openstack-Api-Version: compute 2.90 Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Openstack-System-Scope: None Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: User-Agent: python-novaclient Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Auth-Token: gAAAAABjBe2HX2dK6a-vTMoaRvMW-nIHV68dXFbsq39IsiUjOnXJVOQzK4m1F1Wct8GGf830Qh-UZ2vJM9GkDZFo7w1hvnysz5EnqH5BIgeEK438L4flYJ29eP7NdxS63NZ30xw6zEADQ250CrvPk0YheG-aFHOPklLbg8UZ_1EvX012A08Ik5g Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Domain-Id: None Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Domain-Name: None Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Identity-Status: Confirmed Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Is-Admin-Project: True Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Domain-Id: default Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Domain-Name: Default Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Name: admin Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Role: member,admin,reader Aug 24 09:21:11.982716 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Roles: member,admin,reader Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e359feabfca34b0e8852e124e6b4b5a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant: admin Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant-Name: admin Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User: admin Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Domain-Id: default Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Domain-Name: Default Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Id: d1828412cb04465dbfa15b26582aa6de Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Name: admin Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: method: > Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: exception: Flavor 84 could not be found. Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: action_args: {'id': '84'} Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:21:11.984275 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:11.985254 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:11.986547 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-a57bcd07-8f3a-4742-b89b-c70cc624fa27 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:21:11.987909 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-a57bcd07-8f3a-4742-b89b-c70cc624fa27 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.387169 Aug 24 09:21:11.987909 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 23/44] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Aug 24 09:21:11 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 09:21:11.993966 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-b62b5b7b-015c-497a-b3aa-16e8df253eb3 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:12.009072 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-b62b5b7b-015c-497a-b3aa-16e8df253eb3 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018714 Aug 24 09:21:12.009602 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 22/45] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Aug 24 09:21:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:21:12.019423 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-33acce73-5cbf-473c-a6de-686f07f08860 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:12.036338 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-33acce73-5cbf-473c-a6de-686f07f08860 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020342 Aug 24 09:21:12.036856 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 24/46] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Aug 24 09:21:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:21:12.046292 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-8a9b1a66-8ce0-48b3-8fc2-23683a9242a0 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:12.051753 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.wsgi [None req-8a9b1a66-8ce0-48b3-8fc2-23683a9242a0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-8a9b1a66-8ce0-48b3-8fc2-23683a9242a0 admin admin] Request method failure captured: Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Accept: application/json Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Accept-Encoding: gzip, deflate Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Connection: keep-alive Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Content-Length: 0 Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Host: 10.222.0.16 Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Openstack-Api-Version: compute 2.90 Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Openstack-System-Scope: None Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: User-Agent: python-novaclient Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Auth-Token: gAAAAABjBe2HX2dK6a-vTMoaRvMW-nIHV68dXFbsq39IsiUjOnXJVOQzK4m1F1Wct8GGf830Qh-UZ2vJM9GkDZFo7w1hvnysz5EnqH5BIgeEK438L4flYJ29eP7NdxS63NZ30xw6zEADQ250CrvPk0YheG-aFHOPklLbg8UZ_1EvX012A08Ik5g Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Domain-Id: None Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Domain-Name: None Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Identity-Status: Confirmed Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Is-Admin-Project: True Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Domain-Id: default Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Domain-Name: Default Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Name: admin Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Role: member,admin,reader Aug 24 09:21:12.053249 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Roles: member,admin,reader Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e359feabfca34b0e8852e124e6b4b5a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant: admin Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant-Name: admin Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User: admin Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Domain-Id: default Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Domain-Name: Default Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Id: d1828412cb04465dbfa15b26582aa6de Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Name: admin Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: method: > Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: exception: Flavor 84 could not be found. Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: action_args: {'id': '84'} Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:21:12.054725 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:12.055742 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:12.057087 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-8a9b1a66-8ce0-48b3-8fc2-23683a9242a0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:21:12.058852 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-8a9b1a66-8ce0-48b3-8fc2-23683a9242a0 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011865 Aug 24 09:21:12.058852 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 23/47] 10.222.0.16 () {60 vars in 1190 bytes} [Wed Aug 24 09:21:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 09:21:13.017315 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-33acce73-5cbf-473c-a6de-686f07f08860 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:13.018314 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-33acce73-5cbf-473c-a6de-686f07f08860 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 24 09:21:13.018738 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 25/48] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:13.542406 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-9ee26e16-fd49-463a-bf5b-aa5fbdb64b21 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:13.548166 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.wsgi [None req-9ee26e16-fd49-463a-bf5b-aa5fbdb64b21 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-9ee26e16-fd49-463a-bf5b-aa5fbdb64b21 admin admin] Request method failure captured: Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Accept: application/json Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Accept-Encoding: gzip, deflate Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Connection: keep-alive Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Content-Length: 0 Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Host: 10.222.0.16 Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Openstack-Api-Version: compute 2.90 Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Openstack-System-Scope: None Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: User-Agent: python-novaclient Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Auth-Token: gAAAAABjBe2I9Oa076LvBqQF8aDY9PMRavGQa3hYTrkZ5BlY-oj8AZzXTlrv4qetI_SI9b5nCXPOq-r3qMSuPMAjNIGU2lU3yK7mrhVzH31qjYA35SBxPOiUhe364--I4YmlDMF9YE3g8x5RwhGhz4_95-b-rhBJz_d6SOmVCAPCCi2XbyU1zb8 Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Domain-Id: None Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Domain-Name: None Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Identity-Status: Confirmed Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Is-Admin-Project: True Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Domain-Id: default Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Domain-Name: Default Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Project-Name: admin Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Role: member,admin,reader Aug 24 09:21:13.549652 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Roles: member,admin,reader Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e359feabfca34b0e8852e124e6b4b5a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant: admin Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-Tenant-Name: admin Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User: admin Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Domain-Id: default Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Domain-Name: Default Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Id: d1828412cb04465dbfa15b26582aa6de Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: X-User-Name: admin Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: method: > Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: exception: Flavor 451 could not be found. Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: action_args: {'id': '451'} Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:21:13.551216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:13.552319 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.553375 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-9ee26e16-fd49-463a-bf5b-aa5fbdb64b21 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105924) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:21:13.554473 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-9ee26e16-fd49-463a-bf5b-aa5fbdb64b21 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.394516 Aug 24 09:21:13.554473 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 24/49] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Aug 24 09:21:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 09:21:13.560956 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-4087f745-3272-4dd7-8998-474b3382f1c8 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:13.576477 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-4087f745-3272-4dd7-8998-474b3382f1c8 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019448 Aug 24 09:21:13.577009 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 26/50] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Aug 24 09:21:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:21:13.586216 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:13.600983 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] 10.222.0.16 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018208 Aug 24 09:21:13.601496 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 25/51] 10.222.0.16 () {60 vars in 1210 bytes} [Wed Aug 24 09:21:13 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:21:13.610340 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-7b55190a-4507-4874-9347-2af093c0a51b admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:13.615444 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.wsgi [None req-7b55190a-4507-4874-9347-2af093c0a51b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-7b55190a-4507-4874-9347-2af093c0a51b admin admin] Request method failure captured: Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Accept: application/json Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Accept-Encoding: gzip, deflate Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Connection: keep-alive Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Content-Length: 0 Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Host: 10.222.0.16 Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Openstack-Api-Version: compute 2.90 Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Openstack-System-Scope: None Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: User-Agent: python-novaclient Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Auth-Token: gAAAAABjBe2I9Oa076LvBqQF8aDY9PMRavGQa3hYTrkZ5BlY-oj8AZzXTlrv4qetI_SI9b5nCXPOq-r3qMSuPMAjNIGU2lU3yK7mrhVzH31qjYA35SBxPOiUhe364--I4YmlDMF9YE3g8x5RwhGhz4_95-b-rhBJz_d6SOmVCAPCCi2XbyU1zb8 Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Domain-Id: None Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Domain-Name: None Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Identity-Status: Confirmed Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Is-Admin-Project: True Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Openstack-Nova-Api-Version: 2.90 Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Domain-Id: default Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Domain-Name: Default Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Project-Name: admin Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Role: member,admin,reader Aug 24 09:21:13.616955 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Roles: member,admin,reader Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e359feabfca34b0e8852e124e6b4b5a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e359feabfca34b0e8852e124e6b4b5a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant: admin Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant-Id: e359feabfca34b0e8852e124e6b4b5a1 Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-Tenant-Name: admin Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User: admin Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Domain-Id: default Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Domain-Name: Default Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Id: d1828412cb04465dbfa15b26582aa6de Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: X-User-Name: admin Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: method: > Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: exception: Flavor 451 could not be found. Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: action_args: {'id': '451'} Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:21:13.618550 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:13.621331 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: ERROR nova.api.openstack.wsgi Aug 24 09:21:13.622617 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-7b55190a-4507-4874-9347-2af093c0a51b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105923) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:21:13.623764 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-7b55190a-4507-4874-9347-2af093c0a51b admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011368 Aug 24 09:21:13.623764 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 27/52] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Aug 24 09:21:13 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 24 09:21:14.574518 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:14.575540 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 24 09:21:14.576013 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 26/53] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:15.096581 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-f43c3935-5588-47ba-acaa-3532e7766d17 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:21:15.169076 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-f43c3935-5588-47ba-acaa-3532e7766d17 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.455851 Aug 24 09:21:15.169484 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 28/54] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Aug 24 09:21:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:21:16.177879 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:16.178877 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 24 09:21:16.179272 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 27/55] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:16.704386 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-909a707b-576d-4e71-91ce-37f06e7f7b0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:21:16.791952 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-909a707b-576d-4e71-91ce-37f06e7f7b0d admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.475249 Aug 24 09:21:16.792509 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 29/56] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Aug 24 09:21:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:21:17.768097 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:17.769101 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Aug 24 09:21:17.769497 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 28/57] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:18.292397 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-4e9d3cc8-b439-44fa-b3d5-f24a43531676 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:21:18.364997 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-4e9d3cc8-b439-44fa-b3d5-f24a43531676 admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.457662 Aug 24 09:21:18.365537 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 30/58] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Aug 24 09:21:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:21:19.337879 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:19.339386 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Aug 24 09:21:19.339814 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 29/59] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:19.877879 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-9d020ede-e140-4a31-b08a-fa1a4820fa8c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:21:19.997868 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-9d020ede-e140-4a31-b08a-fa1a4820fa8c admin admin] 10.222.0.16 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.509148 Aug 24 09:21:19.998415 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 31/60] 10.222.0.16 () {64 vars in 1235 bytes} [Wed Aug 24 09:21:19 2022] POST /compute/v2.1/flavors => generated 409 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 09:21:20.983385 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:20.984410 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 24 09:21:20.984804 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 30/61] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:21:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:21:21.507970 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-37149b67-1ebe-4233-87c4-505579774aba admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:21:21.528322 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-37149b67-1ebe-4233-87c4-505579774aba admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.404426 Aug 24 09:21:21.528842 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 32/62] 10.222.0.16 () {60 vars in 1202 bytes} [Wed Aug 24 09:21:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:22:14.708854 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:22:14.709791 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-017e505c-099e-4454-a0a0-d98cdf03fdcc admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 24 09:22:14.710209 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 31/63] 10.222.0.16 () {54 vars in 931 bytes} [Wed Aug 24 09:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:22:14.721654 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:15.101641 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-eaa0f217-a1aa-4b5c-b3a1-4c8f7c7c93fd admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:22:15.122985 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-eaa0f217-a1aa-4b5c-b3a1-4c8f7c7c93fd admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.405826 Aug 24 09:22:15.123524 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 33/64] 10.222.0.16 () {60 vars in 1292 bytes} [Wed Aug 24 09:22:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:22:15.144114 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG dbcounter [-] [105924] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105924) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:22:15.147776 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-d8deaddd-a51d-42d6-87f5-c444a1aee16f admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:22:15.155253 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-d8deaddd-a51d-42d6-87f5-c444a1aee16f admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012570 Aug 24 09:22:15.155802 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 32/65] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Aug 24 09:22:15 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:22:15.167917 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-841d1a5c-7605-4c49-91a6-990a8b59c7a4 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:22:15.175693 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-841d1a5c-7605-4c49-91a6-990a8b59c7a4 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012126 Aug 24 09:22:15.176230 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 34/66] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Aug 24 09:22:15 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:22:15.188400 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:22:15.195849 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010966 Aug 24 09:22:15.196339 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 33/67] 10.222.0.16 () {60 vars in 1286 bytes} [Wed Aug 24 09:22:15 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:22:15.207807 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-a76d2121-5de5-4e30-a0cd-3b633052ab82 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:22:15.216073 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-a76d2121-5de5-4e30-a0cd-3b633052ab82 admin admin] 10.222.0.16 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011930 Aug 24 09:22:15.216589 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 35/68] 10.222.0.16 () {60 vars in 1283 bytes} [Wed Aug 24 09:22:15 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:25:52.621523 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:25:52.622533 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 24 09:25:52.622930 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 34/69] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:25:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:25:52.763471 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_api:SELECT=6 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:25:52.900150 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:25:52.902443 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:25:52.902443 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: warnings.warn(msg) Aug 24 09:25:52.903540 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:25:52.904026 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:25:52.904445 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:25:52.905145 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:25:52.905582 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:25:52.905992 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:25:52.939674 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-10538282-c8f8-44e2-862e-5116ae7d01c3 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.177518 Aug 24 09:25:52.940224 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 36/70] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Aug 24 09:25:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:25:53.770537 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:25:53.771562 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 24 09:25:53.771979 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:25:53.961402 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:25:53.964049 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:25:53.964049 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: warnings.warn(msg) Aug 24 09:25:53.965131 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:25:53.965597 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:25:53.966015 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:25:53.966711 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:25:53.967151 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:25:53.967557 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:25:53.986977 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-3548ae8e-3b58-4d1c-b98c-629b1cbcb2a4 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076461 Aug 24 09:25:53.987462 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 37/72] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Aug 24 09:25:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 24 09:26:05.232545 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:26:05.233547 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 24 09:26:05.233943 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 36/73] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:26:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:26:05.386319 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_cell0:SELECT=4 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:26:05.387038 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_cell1:SELECT=4 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:26:05.387669 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG dbcounter [-] [105923] Writing DB stats nova_api:SELECT=8 {{(pid=105923) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:26:05.439682 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:26:05.442231 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:26:05.442231 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: warnings.warn(msg) Aug 24 09:26:05.443929 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:26:05.448540 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:26:05.448540 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:26:05.448540 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:26:05.448540 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:26:05.448935 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:26:05.473004 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-7daa8478-5f75-469d-b48f-c9d2bd98721f admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.091083 Aug 24 09:26:05.473574 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 38/74] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Aug 24 09:26:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:26:06.307506 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: DEBUG nova.api.openstack.wsgi [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] Calling method '>' {{(pid=105924) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:26:06.308535 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: INFO nova.api.openstack.requestlog [None req-ddcc30f1-ecfe-483e-a1e5-1fe498798674 admin admin] 10.222.0.16 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 24 09:26:06.308924 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: [pid: 105924|app: 0|req: 37/75] 10.222.0.16 () {56 vars in 1074 bytes} [Wed Aug 24 09:26:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:26:06.502858 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG nova.api.openstack.wsgi [None req-624566cf-0644-4344-9596-a08376227893 admin admin] Calling method '>' {{(pid=105923) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:26:06.505219 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 09:26:06.505219 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: warnings.warn(msg) Aug 24 09:26:06.506298 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-624566cf-0644-4344-9596-a08376227893 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:26:06.506763 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-624566cf-0644-4344-9596-a08376227893 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:26:06.507180 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-624566cf-0644-4344-9596-a08376227893 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:26:06.507928 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-624566cf-0644-4344-9596-a08376227893 admin admin] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:26:06.508363 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-624566cf-0644-4344-9596-a08376227893 admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:26:06.508771 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: DEBUG oslo_concurrency.lockutils [None req-624566cf-0644-4344-9596-a08376227893 admin admin] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105923) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:26:06.529966 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: INFO nova.api.openstack.requestlog [None req-624566cf-0644-4344-9596-a08376227893 admin admin] 10.222.0.16 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078497 Aug 24 09:26:06.530507 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: [pid: 105923|app: 0|req: 39/76] 10.222.0.16 () {60 vars in 1193 bytes} [Wed Aug 24 09:26:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:27:06.505511 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: Wed Aug 24 09:27:06 2022 - graceful shutdown triggered... Aug 24 09:27:06.506035 dv-cinder-850321-5-iscsi devstack@n-api.service[105923]: Gracefully killing worker 1 (pid: 105923)... Aug 24 09:27:06.505754 dv-cinder-850321-5-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 24 09:27:06.506856 dv-cinder-850321-5-iscsi devstack@n-api.service[105924]: Gracefully killing worker 2 (pid: 105924)... Aug 24 09:27:07.506659 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: worker 1 buried after 1 seconds Aug 24 09:27:07.507192 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: worker 2 buried after 1 seconds Aug 24 09:27:07.507192 dv-cinder-850321-5-iscsi devstack@n-api.service[105922]: goodbye to uWSGI. Aug 24 09:27:07.508232 dv-cinder-850321-5-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 24 09:27:07.508820 dv-cinder-850321-5-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 24 09:27:07.511543 dv-cinder-850321-5-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 24 09:27:07.522523 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 24 09:27:07.524452 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 09:27:07 2022] *** Aug 24 09:27:07.524632 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 09:27:07.524820 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 09:27:07.524970 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: nodename: dv-cinder-850321-5-iscsi Aug 24 09:27:07.525115 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: machine: x86_64 Aug 24 09:27:07.525258 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: clock source: unix Aug 24 09:27:07.525412 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: pcre jit disabled Aug 24 09:27:07.525677 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: detected number of CPU cores: 4 Aug 24 09:27:07.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: current working directory: / Aug 24 09:27:07.525977 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: detected binary path: /usr/bin/uwsgi-core Aug 24 09:27:07.526126 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: your processes number limit is 47680 Aug 24 09:27:07.526282 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: your memory page size is 4096 bytes Aug 24 09:27:07.526429 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: detected max file descriptor number: 2048 Aug 24 09:27:07.526580 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: lock engine: pthread robust mutexes Aug 24 09:27:07.526893 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: thunder lock: enabled Aug 24 09:27:07.527224 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 24 09:27:07.527456 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: Python main interpreter initialized at 0x55f70a2d39c0 Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: python threads support enabled Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: your server socket listen backlog is limited to 100 connections Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: your mercy for graceful operations on workers is 90 seconds Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: *** Operational MODE: preforking *** Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: *** uWSGI is running in multiple interpreter mode *** Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: spawned uWSGI master process (pid: 121128) Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: spawned uWSGI worker 1 (pid: 121141, cores: 1) Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: spawned uWSGI worker 2 (pid: 121142, cores: 1) Aug 24 09:27:07.575746 dv-cinder-850321-5-iscsi devstack@n-api.service[121128]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 09:27:07.568627 dv-cinder-850321-5-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 24 09:27:08.229941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 09:27:08.230536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 24 09:27:09.418228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:27:09.418228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: from cryptography.utils import int_from_bytes Aug 24 09:27:09.418228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:27:09.418228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: from cryptography.utils import int_from_bytes Aug 24 09:27:09.430438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:27:09.430438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: from cryptography.utils import int_from_bytes Aug 24 09:27:09.430967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 09:27:09.430967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: from cryptography.utils import int_from_bytes Aug 24 09:27:11.863880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:27:11.864471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:27:11.864764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:27:11.865056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:27:11.865316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:27:11.865712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.866029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.866361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.866684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.867177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.867500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.867863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.868189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.868528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.868798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.869121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.869449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-5-iscsi {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.869776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.870091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.870407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.870733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.871044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.871369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.871728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.872236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.874227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.874227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.874227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.874593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.874836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.875154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.875478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.875837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.876157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.876480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.876882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-5-iscsi {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.877212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.877524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.877832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.878255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.878577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.878881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.879206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.879533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.879889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.880212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.880535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.880862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.881175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.881492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.881790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.882103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.882423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.882733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.883034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.883289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.883631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.883746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 09:27:11.884162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 09:27:11.884238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.884238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.884550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 09:27:11.884705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.884862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 09:27:11.885022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.885199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 09:27:11.885352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.885352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.885663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.885826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.885980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.886126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.886293 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.886445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.886590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.886744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.886907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.887077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.887224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.887378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.887552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.887732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.887894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.888060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.888215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.888368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.888525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.888680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.888832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.888985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.889149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-850321-5-iscsi {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.889320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.889499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.889651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.889796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.889947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.890093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.890248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.890408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.890581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.890739 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.890892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.891045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.891221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.891453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.891663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.891663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.891960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.892129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.892291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.892445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.893490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.893664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.893820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.893984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.894147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.894301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.894455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.894611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.894756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.894910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.895065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.895259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.895426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.895570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.895813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.895978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.896141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.896298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.896451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-850321-5-iscsi {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.896612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.896767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.896921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.897067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.897219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.897372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.897534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.897693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.897847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.898038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.898305 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.898464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.898619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.898775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.898922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.899118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.899264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.899416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.899572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.899765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.899912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.899912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.900208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.900355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.900513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.900666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.900810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.900954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.901106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.901251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.901405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.901560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.901714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.901882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.902036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.902202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.902357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.902510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.902676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.902676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.903352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.903698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.903851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.903997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.904149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.904311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.904466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.904612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.904778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.904925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.905081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.905239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.905394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.905547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.905712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.905865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.906026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.906173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.906316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.906480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.906633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.906788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.906941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.907087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.907230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.907376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.907528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.907752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.907900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.908064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.908210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.908449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.908622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.908783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.908937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.909085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.909237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.909408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.910011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.910184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.910339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.910493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.910641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.910795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.16 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.910960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.911546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.16 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.911741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.911890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.912076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.912237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.912394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.912548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.912703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.912856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.913352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.913517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.913854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.914026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.914185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.914333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.914485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.914639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.914801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.914948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.915099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.915246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.915391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.915545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.915728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.915877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.915877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.916186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.916339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.916494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.916640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.916794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.916952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.917097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.917242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.917400 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.917553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.917707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.917872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.918037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.918184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.918338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.918579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.918739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.918893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.919048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.919206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.919360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.919506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.919725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.919875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.920033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.920190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.920842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.920999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.921147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.921298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.921443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.921602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.921748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.921900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.922046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.922192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.922337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.922505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.922658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.922810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.922963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.923463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.923742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.924057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.924220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.924374 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.924538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.924685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.924836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.925187 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.925365 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.925521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.925677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.925830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.925983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.926135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.926282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.926441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.926588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.926732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.926732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.927013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.927013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.927349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.927349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.927699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.927894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.928052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.928206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.928367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.928513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.929311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.929479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.930099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.930264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.930423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.930585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.930739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.930893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.931079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.931239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.931393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.931554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.931771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.931927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.932074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.932218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.932377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.932585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.932743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.932899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.933045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.933190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.933738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.933904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.934248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.934411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.934557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.934704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 09:27:11.934870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.935027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.935193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.935339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.935492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.935656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.935822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.935978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.936702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.936952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.937136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.937136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.937437 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.937583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.937746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.937902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.938064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.938221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.938375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.938520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.938665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.938816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.938962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.939135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.939845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.940006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.940162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.940328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.940489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.940637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.940789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.940944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.941098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.941244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.941404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.941558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.941703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.941856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.942018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.942165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.942335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.942483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.942628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.942783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.942945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.943093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.943248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.943402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.943979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.944165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.944486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.944655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.944814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.944968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.945122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.945277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.945430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.945585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.945739 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.945885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.946030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.946183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.946329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.946484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.946637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.946802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.946957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.947103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.947250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.947404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.947550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.947762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.947919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.948081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.948228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.948383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.948529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.948674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.948837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.948983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.949141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.949557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.949722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.949869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.949869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.950145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.950305 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.950461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.950614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.950760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.950904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.951061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.951219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.951366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.951366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.951696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.951975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.952121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.952283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.952438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.952593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.952750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.952895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.953054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.953211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.953356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.953501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.953647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.954189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.954448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.954778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.954934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.955081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.955235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.955389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.955549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.955860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.956027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.956175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.956319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.956472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.956632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.956788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.956934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.957080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.957232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.957390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.957544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.957697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.957855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.958017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.958173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.958334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.958488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.958640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.958787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.958931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.959084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.959246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.959399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.959572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.959808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.960010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.960161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.960324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.960472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.960617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.960770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.960917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.961075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.961229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.961376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.961520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.961672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.961818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.962250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.962408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.962562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.962716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.962864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.963011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.963202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.963354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.963501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.963677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.963841 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.964334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.964512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.964742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.965061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.965236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.965387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.965534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.965689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.965836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.965989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.966136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.966290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.966446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.966593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.966750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.966895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.967141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.967335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.967500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.967682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.967839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.967985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.968157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.968313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.968480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.968627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.968779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.968938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.969083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.969238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.969386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.969531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.969677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.969858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.970098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.970274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.970489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.970643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.970803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.970963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.971131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.971298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.971459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.971653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.971823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.971984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.972136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.972296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.972449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.972600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.972749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.973030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.973213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.973390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.973544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.973712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.973864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.974016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.974564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.974754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.974984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.975264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.975424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.975596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.975596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.975929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.975929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.976228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.976386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.976547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.976715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.976874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.977025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.977185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.977344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.977495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.977656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.977808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.977976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.978133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.978285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.978444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.978604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.978765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.978765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.979063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.979215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.979380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.979546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.979772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.979927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.980117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.980346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.980513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.980675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.980838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.980989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.981150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.981310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.981476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.981637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.981796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.981949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.982100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.982272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.982426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.982583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.982736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.983430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.983605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.983776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.983933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.983933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.984208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.984708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.984872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.985127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.985307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.985540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.985699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.985846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.986006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.986172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.986325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.986486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.986647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.986800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.987030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.987195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.987359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.987519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.987736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.987892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.988052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.988213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.988364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.988523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.988693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.988847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.989007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.989167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.989321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.989483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.989648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.990475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.990638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.990791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.990952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.991121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.991290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.993699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.993876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.994041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.994202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.994372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.994901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.995068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.995321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.995482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.995770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.995943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.996106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.996259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.996420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.996575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.996737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.996890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.997051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.997215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.997384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.997538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.997701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.997856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.998008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.998159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.998318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.998519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.999202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.999351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.999497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.999692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.999843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:11.999999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.000156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.000311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.000475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.000704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.000873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.001036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.001184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.001339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.001485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.001629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.001800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.001960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.002116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.002263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.002408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.002560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.002705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.002864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.003011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.003155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.003308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.003454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.003630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.003809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.003958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.004117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.004270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.004429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.004596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.005113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.005305 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.005529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.005688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.005946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.006124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.006290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.006443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.006611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.006765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.006944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.007157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.007323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.007485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.007656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.007816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.007816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.008120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.008274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.008450 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.008603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.008756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.008917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.009071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.009231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.009393 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.009554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.009714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.009875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.009875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.010167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.010319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.010481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.010641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.010894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.011061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.011229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.011396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.011549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.011739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.011902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.012055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.012206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.012373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.012535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.012713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.012866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.013020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.013172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.013339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.013500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.013656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.013817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.013817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.014634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.014634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.014634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.014634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.014634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.016097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.016369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.016532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.016694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.016855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.017009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.017169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.017336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.017491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.017644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.017644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.017946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.018100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.018266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.018429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.018592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.018752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.018905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.019057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.019218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.019380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.019533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.019721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.019875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.020055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.020216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.020370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.020520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.020674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.020834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.021095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.021254 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.021454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.021611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.021773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.021933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.022097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.022269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.022539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.022698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.022821 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.022942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.023136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.023254 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.023376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.023498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.027646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.027845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.028007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.028171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.028415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.028585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.028749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.028913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.029069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.029229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.029390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.029543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.029718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.030417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.030582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.030736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.030909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.031083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.031324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.031493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.031715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.031873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.032025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.032178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.032340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.032503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.032656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.032808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.032960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.033123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.033328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.033489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.033642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.033794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.033954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.034106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.034275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.034429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.034581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.034743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.034968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.035226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.035485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.035665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.036232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.036405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.036662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.036834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.037124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.037307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.037493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.038750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.038924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.039098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.039264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.039433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.039639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.039802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.039955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.040126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.040289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.040443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.040605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.040765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.040927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.041095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.041257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.041561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.041727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.041889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.042057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.042212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.042212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.042529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.042692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.042854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.043017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.043177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.043344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.043498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.043692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.043849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.044014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.044167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.044326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.044712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.044933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.045098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.045283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.045566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.045725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.045883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.046457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.046662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.046911 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.047072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.047226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.047389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.047543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.047734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.048489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.048658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.048827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.048993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.049159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.049313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.049473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.049655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.049822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.049975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.050130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.050290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.050445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.050607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.050769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.050922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.051085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.051257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.051420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.051616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.051875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.052167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.052356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.052521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.052674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.052837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.052990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.053144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.053296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.053460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.053622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.053784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.053937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.054096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.054358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.054525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.054655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.054778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.054899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.055065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.055192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.055323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.055493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.061686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.061821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.061914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.061990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.061990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.062985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.063931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.064986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.065979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.066919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.067949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.068912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.069982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.070939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071592 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.071947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072465 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.072962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.073978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074675 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.074944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.075958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.076104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.076200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.076292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.076377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.076501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.077996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.078880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.079955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.080913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.081985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082187 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.082935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.083992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.084991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.085971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.086941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.087499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.087688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.087855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.088013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.088163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.088327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.088477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.088477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.088778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.088928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.089076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.089243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.089407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.089567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.089723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.089885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.089885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.090182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.090345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.090495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.090652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.090652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.090936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.091092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.091269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.091427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.091576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.091798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.091798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.092099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.092319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.092963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.093930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.094922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.095850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.096986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.097969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098358 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098358 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.098958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099496 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.099977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.100937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.101963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.102998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.103936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.104960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.105923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.106939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.107956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.108962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.109920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.110845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.111904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.112057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.112152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.112404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.112505 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.112736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.112840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.113078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.113171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.113402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.113494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.113720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.113826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.114036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.114133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.114353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.114446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.114672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.114773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.114990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.115083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.115308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.115407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.115656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.115763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.115976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.116069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.116292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.116384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.116609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.116748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.116926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.117059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.117245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.117376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.117567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.117695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.117895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.118026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.118206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.118348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.118536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.118669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.118858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.118990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.119185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.119332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.119506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.119704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.119836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.119964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.120167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.120316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.120482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.120606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.120796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.120929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.121111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.121253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.121426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.121566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.121739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.121905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.122049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.122233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.122368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.122556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.122681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.122883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.123025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.123222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.123365 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.123572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.123734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.123879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.124017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.124240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.124379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.124569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.124715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.124897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.125032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.125246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.125380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.125563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.125702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.125897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.126031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.126223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.126355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.126540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.126687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.126853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.126992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.127164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.127306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.127436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:27:12.127600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.127887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.128225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.128559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.128875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.129192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.129508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.129828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.130156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.130472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.130789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.131101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.131419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.131757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.132072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.132386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.132699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.133015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.133325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.133637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.133951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.134263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.134576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.134890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.135210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.135523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.135861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.136175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.136490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.136803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.137178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.137515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.137840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.138176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.138497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.138828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.139700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.140032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.140362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.140689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.141015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.141357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.141679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.141999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.142319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.142639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.142960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.143280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.143638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.143977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.144292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.144625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.144948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.145277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.145603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.145926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.146261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.146580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.146897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.147216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.147535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.147876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.148200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.148516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.148834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.149155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.149476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.149811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.150143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.150461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.150797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.151130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.151482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.151826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.152255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.152579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.152903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.153222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.153536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 09:27:12.153786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 09:27:12.190255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO dbcounter [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Registered counter for database nova_api Aug 24 09:27:12.212443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_db.sqlalchemy.engines [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.217909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Registered counter for database nova_api Aug 24 09:27:12.219231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writer thread running {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.241096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.249661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.276464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.context [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),050771cb-a121-45a6-9902-2168b65adc50(cell1) {{(pid=121141) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 09:27:12.280585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:27:12.281077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:27:12.282664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:27:12.283416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:27:12.283902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:27:12.285875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:27:12.287875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO dbcounter [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Registered counter for database nova_cell0 Aug 24 09:27:12.291904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO dbcounter [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Registered counter for database nova_cell1 Aug 24 09:27:12.299740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_db.sqlalchemy.engines [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.301883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_db.sqlalchemy.engines [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.307526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writer thread running {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.308998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.context [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),050771cb-a121-45a6-9902-2168b65adc50(cell1) {{(pid=121142) load_cells /opt/stack/nova/nova/context.py:464}} Aug 24 09:27:12.310181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writer thread running {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.313646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:27:12.314138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:27:12.315787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:27:12.316545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:27:12.316992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:27:12.318974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:27:12.320989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Registered counter for database nova_cell0 Aug 24 09:27:12.325058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Registered counter for database nova_cell1 Aug 24 09:27:12.332870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.335036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.343532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.343904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.462749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO dbcounter [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Registered counter for database nova_cell0 Aug 24 09:27:12.470234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_db.sqlalchemy.engines [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.475021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writer thread running {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.492167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO dbcounter [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Registered counter for database nova_cell0 Aug 24 09:27:12.499349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_db.sqlalchemy.engines [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 09:27:12.507719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writer thread running {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 09:27:12.815669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: WARNING keystonemiddleware.auth_token [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:27:12.824113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: WARNING keystonemiddleware.auth_token [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:27:12.826205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:27:12.833732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:27:13.182449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:27:13.187999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: WARNING keystonemiddleware.auth_token [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 24 09:27:13.189247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: WARNING keystonemiddleware.auth_token [None req-d4dc189d-32bd-404c-a4b3-1d191baad8b3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:27:13.194188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: WARNING keystonemiddleware.auth_token [None req-40309529-bc76-4f16-a66c-9ea2cc9accb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 24 09:27:13.194742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f70a2d39c0 pid: 121142 (default app) Aug 24 09:27:13.200148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f70a2d39c0 pid: 121141 (default app) Aug 24 09:27:48.753515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:48.755212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:48.756358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:48.757089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:49.177751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:49.178803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:49.179784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:49.180480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:27:50.012738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cefe096b-4d5b-4027-8c97-dadd1d416be6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Action: 'create', calling method: .version_select at 0x7fa918dc7700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1457195945", "metadata": {"Type": "work"}}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cefe096b-4d5b-4027-8c97-dadd1d416be6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Request method failure captured: Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 122 Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8UsJndTvdUo5G9ysFbFG_cJ-GeGoEdYdHLGIxjzAeaeQjz0lTjH-bKEfs0x9z5R8FrvQjquf9h0A-Ilkgagf_FxL_ReB73j4c00AQaZfjZyR557nvYkxlXyUPMUt893vsIT3J_qIOEsk8PDctMlqg1YCZYopbGSN3FtlJe3JvHbtk Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:27:50.019081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d04a503a13a48439073f044775b24a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d04a503a13a48439073f044775b24a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b3d64b436fc8454087a68c0506264de6 Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1457195945", "metadata": {"Type": "work"}}} Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 09:27:50.020676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1457195945', 'metadata': {'Type': 'work'}}}} Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise error Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi '#$%' Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:27:50.021708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 09:27:50.023291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 09:27:50.024605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 24 09:27:50.024605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.025534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cefe096b-4d5b-4027-8c97-dadd1d416be6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:27:50.026917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cefe096b-4d5b-4027-8c97-dadd1d416be6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.292093 Aug 24 09:27:50.027680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1/1] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Aug 24 09:27:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1294 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:27:50.040904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-279a1fed-0609-4ad2-839d-5fd4dc1caeb5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Action: 'create', calling method: .version_select at 0x7fa918dc7790>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-540356213", "metadata": {"Type": "work"}}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-279a1fed-0609-4ad2-839d-5fd4dc1caeb5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Request method failure captured: Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 119 Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8UsJndTvdUo5G9ysFbFG_cJ-GeGoEdYdHLGIxjzAeaeQjz0lTjH-bKEfs0x9z5R8FrvQjquf9h0A-Ilkgagf_FxL_ReB73j4c00AQaZfjZyR557nvYkxlXyUPMUt893vsIT3J_qIOEsk8PDctMlqg1YCZYopbGSN3FtlJe3JvHbtk Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:27:50.045132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d04a503a13a48439073f044775b24a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d04a503a13a48439073f044775b24a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b3d64b436fc8454087a68c0506264de6 Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-540356213", "metadata": {"Type": "work"}}} Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 09:27:50.047028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-540356213', 'metadata': {'Type': 'work'}}}} Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise error Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi '0' Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:27:50.047836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 09:27:50.049086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 09:27:50.052893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 24 09:27:50.052893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.052893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-279a1fed-0609-4ad2-839d-5fd4dc1caeb5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:27:50.052893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-279a1fed-0609-4ad2-839d-5fd4dc1caeb5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012483 Aug 24 09:27:50.052893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 2/2] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Aug 24 09:27:50 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 09:27:50.062958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0ac91822-6fc8-4475-92c3-e2ad662d25e6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Action: 'create', calling method: .version_select at 0x7fa918d06280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2056139158", "metadata": {"Type": "work"}}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0ac91822-6fc8-4475-92c3-e2ad662d25e6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Request method failure captured: Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 119 Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8UsJndTvdUo5G9ysFbFG_cJ-GeGoEdYdHLGIxjzAeaeQjz0lTjH-bKEfs0x9z5R8FrvQjquf9h0A-Ilkgagf_FxL_ReB73j4c00AQaZfjZyR557nvYkxlXyUPMUt893vsIT3J_qIOEsk8PDctMlqg1YCZYopbGSN3FtlJe3JvHbtk Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:27:50.066981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d04a503a13a48439073f044775b24a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d04a503a13a48439073f044775b24a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b3d64b436fc8454087a68c0506264de6 Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-2056139158", "metadata": {"Type": "work"}}} Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 09:27:50.069614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-2056139158', 'metadata': {'Type': 'work'}}}} Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise error Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi '' Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:27:50.070358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 24 09:27:50.071660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 24 09:27:50.074484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 24 09:27:50.074484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.074484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0ac91822-6fc8-4475-92c3-e2ad662d25e6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:27:50.074484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0ac91822-6fc8-4475-92c3-e2ad662d25e6 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.015094 Aug 24 09:27:50.074484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 3/3] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Aug 24 09:27:50 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:27:50.079362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26a3c89d-12a2-4b60-a003-11aca23ca06d tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Calling method '.version_select at 0x7fa918d06c10>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:50.403913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1df45aa3-e677-41b7-956a-9c71335ff042 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Action: 'create', calling method: .version_select at 0x7fa918dc9700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-972082567", "metadata": {"Type": "work"}}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:27:50.580410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-26a3c89d-12a2-4b60-a003-11aca23ca06d tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] HTTP exception thrown: Volume tempest-invalid-4151232 could not be found. Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26a3c89d-12a2-4b60-a003-11aca23ca06d tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Request method failure captured: Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-4151232 HTTP/1.1 Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8UsJndTvdUo5G9ysFbFG_cJ-GeGoEdYdHLGIxjzAeaeQjz0lTjH-bKEfs0x9z5R8FrvQjquf9h0A-Ilkgagf_FxL_ReB73j4c00AQaZfjZyR557nvYkxlXyUPMUt893vsIT3J_qIOEsk8PDctMlqg1YCZYopbGSN3FtlJe3JvHbtk Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:27:50.584558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d04a503a13a48439073f044775b24a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d04a503a13a48439073f044775b24a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b3d64b436fc8454087a68c0506264de6 Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Volume tempest-invalid-4151232 could not be found. Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'tempest-invalid-4151232'} Aug 24 09:27:50.586161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-4151232 could not be found. (HTTP 404) (Request-ID: req-0eeb0192-f7f3-4693-8b76-6b10dabdfa8e) Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.587323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 09:27:50.588862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-4151232 could not be found. Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:27:50.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-4151232 could not be found. Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-4151232 could not be found. Aug 24 09:27:50.591616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.594345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26a3c89d-12a2-4b60-a003-11aca23ca06d tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Returning 404 to user: Volume tempest-invalid-4151232 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:27:50.595428 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-26a3c89d-12a2-4b60-a003-11aca23ca06d tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/tempest-invalid-4151232" status: 404 len: 96 microversion: 2.1 time: 0.521249 Aug 24 09:27:50.596177 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 4/4] 10.222.0.16 () {58 vars in 1209 bytes} [Wed Aug 24 09:27:50 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-4151232 => generated 96 bytes in 522 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 24 09:27:50.608514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f32d3dfe-b968-47b0-9121-6e181a1ff30d tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005767 Aug 24 09:27:50.609215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 5/5] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Aug 24 09:27:50 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 09:27:50.618793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-da49e6bb-7041-4eae-9522-368b25dbd848 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004121 Aug 24 09:27:50.624660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 6/6] 10.222.0.16 () {58 vars in 1137 bytes} [Wed Aug 24 09:27:50 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 24 09:27:50.630436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5f1422f4-0269-4c5a-92cc-627bdda834d5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Calling method '.version_select at 0x7fa918c3b5e0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:50.732616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-5f1422f4-0269-4c5a-92cc-627bdda834d5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] HTTP exception thrown: Volume fb82bf4d-b790-495d-b50c-49b350f092d2 could not be found. Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5f1422f4-0269-4c5a-92cc-627bdda834d5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Request method failure captured: Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/os-volumes/fb82bf4d-b790-495d-b50c-49b350f092d2 HTTP/1.1 Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8UsJndTvdUo5G9ysFbFG_cJ-GeGoEdYdHLGIxjzAeaeQjz0lTjH-bKEfs0x9z5R8FrvQjquf9h0A-Ilkgagf_FxL_ReB73j4c00AQaZfjZyR557nvYkxlXyUPMUt893vsIT3J_qIOEsk8PDctMlqg1YCZYopbGSN3FtlJe3JvHbtk Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:27:50.735559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d04a503a13a48439073f044775b24a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d04a503a13a48439073f044775b24a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b3d64b436fc8454087a68c0506264de6 Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Volume fb82bf4d-b790-495d-b50c-49b350f092d2 could not be found. Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'fb82bf4d-b790-495d-b50c-49b350f092d2'} Aug 24 09:27:50.737031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fb82bf4d-b790-495d-b50c-49b350f092d2 could not be found. (HTTP 404) (Request-ID: req-365aa405-05e6-46d1-974d-8708083decfc) Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.738126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 09:27:50.740499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fb82bf4d-b790-495d-b50c-49b350f092d2 could not be found. Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 09:27:50.749664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fb82bf4d-b790-495d-b50c-49b350f092d2 could not be found. Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fb82bf4d-b790-495d-b50c-49b350f092d2 could not be found. Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5f1422f4-0269-4c5a-92cc-627bdda834d5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Returning 404 to user: Volume fb82bf4d-b790-495d-b50c-49b350f092d2 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5f1422f4-0269-4c5a-92cc-627bdda834d5 tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/fb82bf4d-b790-495d-b50c-49b350f092d2" status: 404 len: 109 microversion: 2.1 time: 0.118687 Aug 24 09:27:50.751136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 7/7] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 09:27:50 2022] DELETE /compute/v2.1/os-volumes/fb82bf4d-b790-495d-b50c-49b350f092d2 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:27:50.765381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e6b90a3e-6ea7-4b2a-9bfc-bc86b9aec4fd tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Calling method '.version_select at 0x7fa918c3b700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:50.822260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-e6b90a3e-6ea7-4b2a-9bfc-bc86b9aec4fd tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] HTTP exception thrown: Volume 9458434e-376d-4b46-88b8-efc5979bc36b could not be found. Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e6b90a3e-6ea7-4b2a-9bfc-bc86b9aec4fd tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Request method failure captured: Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-volumes/9458434e-376d-4b46-88b8-efc5979bc36b HTTP/1.1 Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8UsJndTvdUo5G9ysFbFG_cJ-GeGoEdYdHLGIxjzAeaeQjz0lTjH-bKEfs0x9z5R8FrvQjquf9h0A-Ilkgagf_FxL_ReB73j4c00AQaZfjZyR557nvYkxlXyUPMUt893vsIT3J_qIOEsk8PDctMlqg1YCZYopbGSN3FtlJe3JvHbtk Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:27:50.825037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/0d04a503a13a48439073f044775b24a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/0d04a503a13a48439073f044775b24a1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_0d04a503a13a48439073f044775b24a1", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 0d04a503a13a48439073f044775b24a1 Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesNegativeTest-722856119 Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b3d64b436fc8454087a68c0506264de6 Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesNegativeTest-722856119-project Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Volume 9458434e-376d-4b46-88b8-efc5979bc36b could not be found. Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '9458434e-376d-4b46-88b8-efc5979bc36b'} Aug 24 09:27:50.827184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9458434e-376d-4b46-88b8-efc5979bc36b could not be found. (HTTP 404) (Request-ID: req-e0803cad-ff9a-441a-a627-d41b801e34bf) Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.828153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:27:50.829403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9458434e-376d-4b46-88b8-efc5979bc36b could not be found. Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 09:27:50.830691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9458434e-376d-4b46-88b8-efc5979bc36b could not be found. Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9458434e-376d-4b46-88b8-efc5979bc36b could not be found. Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e6b90a3e-6ea7-4b2a-9bfc-bc86b9aec4fd tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] Returning 404 to user: Volume 9458434e-376d-4b46-88b8-efc5979bc36b could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e6b90a3e-6ea7-4b2a-9bfc-bc86b9aec4fd tempest-VolumesNegativeTest-722856119 tempest-VolumesNegativeTest-722856119-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/9458434e-376d-4b46-88b8-efc5979bc36b" status: 404 len: 109 microversion: 2.1 time: 0.076012 Aug 24 09:27:50.836021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 8/8] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:27:50 2022] GET /compute/v2.1/os-volumes/9458434e-376d-4b46-88b8-efc5979bc36b => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:27:53.060525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1df45aa3-e677-41b7-956a-9c71335ff042 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.893084 Aug 24 09:27:53.075464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1/9] 10.222.0.16 () {60 vars in 1156 bytes} [Wed Aug 24 09:27:49 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3909 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 09:27:53.076310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-503590bf-6893-4b96-af31-26d86b96b787 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Calling method '.version_select at 0x7fa918d06280>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:53.186808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-503590bf-6893-4b96-af31-26d86b96b787 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927" status: 200 len: 352 microversion: 2.1 time: 0.108226 Aug 24 09:27:53.186808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 9/10] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:27:53 2022] GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 => generated 352 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:27:54.198195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8ffc20db-25b3-4a6b-82fb-a93ab3e648d4 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Calling method '.version_select at 0x7fa918c9b550>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:54.324027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8ffc20db-25b3-4a6b-82fb-a93ab3e648d4 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927" status: 200 len: 352 microversion: 2.1 time: 0.132912 Aug 24 09:27:54.331419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 2/11] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:27:54 2022] GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 => generated 352 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:27:55.341104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dcf6b524-02f0-4d48-906a-1da306c2d783 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Calling method '.version_select at 0x7fa918c3bc10>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:55.466423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dcf6b524-02f0-4d48-906a-1da306c2d783 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927" status: 200 len: 353 microversion: 2.1 time: 0.129486 Aug 24 09:27:55.467143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 10/12] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:27:55 2022] GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 => generated 353 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:27:55.488826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-abdfd63d-257a-42a7-9371-886caf6d26e7 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Calling method '.version_select at 0x7fa918c9bc10>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:55.639343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-abdfd63d-257a-42a7-9371-886caf6d26e7 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927" status: 200 len: 353 microversion: 2.1 time: 0.161434 Aug 24 09:27:55.640605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 3/13] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:27:55 2022] GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 => generated 353 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:27:55.660624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58808292-0c64-4171-9819-aaf6efe95dc6 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Calling method '.version_select at 0x7fa918c3b280>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:55.934349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58808292-0c64-4171-9819-aaf6efe95dc6 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927" status: 202 len: 0 microversion: 2.1 time: 0.277168 Aug 24 09:27:55.935378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 11/14] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 09:27:55 2022] DELETE /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:27:55.945246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0ba00cdc-cdcf-458e-b9e4-cac4418ba3eb tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Calling method '.version_select at 0x7fa918cb5310>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:56.058850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0ba00cdc-cdcf-458e-b9e4-cac4418ba3eb tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927" status: 200 len: 352 microversion: 2.1 time: 0.118439 Aug 24 09:27:56.060025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 4/15] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:27:55 2022] GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 => generated 352 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:27:57.072667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-debc7664-143d-4ef6-bf71-be84c517eb28 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Calling method '.version_select at 0x7fa918c43280>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:27:57.161882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-debc7664-143d-4ef6-bf71-be84c517eb28 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] HTTP exception thrown: Volume da1b421c-1c53-44e3-8ab1-da5a12d6b927 could not be found. Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-debc7664-143d-4ef6-bf71-be84c517eb28 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Request method failure captured: Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 HTTP/1.1 Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8VMTqItpGVXkRD1hQib_aXZfi-27Nsmf3NRZVvT-ZaxfKVheBZHoTiBtX0Z5T0KQkPsmBo72hHdLj9BGboHSqFULrveEKzo1kEmNGnarZdb9O2jDdEI2uqxtTpaCZ_7n2oXv5r6kBqT8vmMNREzd7EK5-Wq60Azkst53GkC-uZVh4 Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 1a132169db34442cb6e7f2ba7cf94962 Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesGetTestJSON-922919180 Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:27:57.164289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/1a132169db34442cb6e7f2ba7cf94962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a132169db34442cb6e7f2ba7cf94962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/1a132169db34442cb6e7f2ba7cf94962"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_1a132169db34442cb6e7f2ba7cf94962", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesGetTestJSON-922919180 Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 1a132169db34442cb6e7f2ba7cf94962 Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesGetTestJSON-922919180 Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesGetTestJSON-922919180-project Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: a99817614d86407ea10902774e47fca2 Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesGetTestJSON-922919180-project Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Volume da1b421c-1c53-44e3-8ab1-da5a12d6b927 could not be found. Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'da1b421c-1c53-44e3-8ab1-da5a12d6b927'} Aug 24 09:27:57.165802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume da1b421c-1c53-44e3-8ab1-da5a12d6b927 could not be found. (HTTP 404) (Request-ID: req-201b05d5-6555-4060-9094-c23b8823bf36) Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:57.166660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 09:27:57.167891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume da1b421c-1c53-44e3-8ab1-da5a12d6b927 could not be found. Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 09:27:57.169071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume da1b421c-1c53-44e3-8ab1-da5a12d6b927 could not be found. Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume da1b421c-1c53-44e3-8ab1-da5a12d6b927 could not be found. Aug 24 09:27:57.170479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:27:57.172090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-debc7664-143d-4ef6-bf71-be84c517eb28 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] Returning 404 to user: Volume da1b421c-1c53-44e3-8ab1-da5a12d6b927 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:27:57.173432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-debc7664-143d-4ef6-bf71-be84c517eb28 tempest-VolumesGetTestJSON-922919180 tempest-VolumesGetTestJSON-922919180-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927" status: 404 len: 109 microversion: 2.1 time: 0.104278 Aug 24 09:27:57.174477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 12/16] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:27:57 2022] GET /compute/v2.1/os-volumes/da1b421c-1c53-44e3-8ab1-da5a12d6b927 => generated 109 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:28:01.207443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8a289e54-f2cc-4416-affc-7487a69437b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: .version_select at 0x7fa918c9bdc0>, body: {"keypair": {"name": "tempest-keypair-1131250624", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOL1XWPAtHkpgeTMu6FrXcHc1Ww8OWGFbvaq8ppT0UR66G/KjLfijKJNdCnJ+u5v6K/+uYfRuBrjMGifiSoU8IhsIGat/dOLNrj9wPKQ6zpBj/hy6hEJ+d0a6xE8O/6gQ=="}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:01.319967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-8a289e54-f2cc-4416-affc-7487a69437b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:28:01.346758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-8a289e54-f2cc-4416-affc-7487a69437b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:28:01.505202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8a289e54-f2cc-4416-affc-7487a69437b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.515132 Aug 24 09:28:01.505824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 5/17] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 09:28:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:28:05.085640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-8170282", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "networks": [{"uuid": "30bcb7b9-5be7-471b-98b5-e9cf3aa51932"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:05.368444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] validate_networks() for [('30bcb7b9-5be7-471b-98b5-e9cf3aa51932', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:28:07.566444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cf1f95a8-6eda-4bc4-9e4d-2a52cfaa6a13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Action: 'create', calling method: .version_select at 0x7fa918c0e310>, body: {"keypair": {"name": "tempest-keypair-310762633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKG3n1laotnzEiDESiRCG4+F7yUsO8/Ky2v93Fz2cm11Y2pAVnNegQtddcQ0ipnd4Ku4se4yq4nBUs5T1bbMJMwbS2Vp3+DNL6XU0XPB9P5zNQ9dIWWTQZrSrjAQ7lad3Q=="}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:07.610990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-cf1f95a8-6eda-4bc4-9e4d-2a52cfaa6a13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:28:07.616427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-cf1f95a8-6eda-4bc4-9e4d-2a52cfaa6a13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for user cbcaa84bc9c54d7aa4178d0174a5936e and project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:28:07.734076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cf1f95a8-6eda-4bc4-9e4d-2a52cfaa6a13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.468637 Aug 24 09:28:07.734728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 6/18] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Aug 24 09:28:07 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 471 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 09:28:08.048657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:28:08.049626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:28:08.050246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:28:08.050787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:28:08.052068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:28:08.102906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:08.103868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:08.104473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:08.105436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:08.108250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:08.109532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:08.152677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Getting quotas for project fe8949d7fc8b4ca89fd81421d7e94122. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:28:08.163447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Getting quotas for user 6cad69b6035948fe91e9beb66c807d28 and project fe8949d7fc8b4ca89fd81421d7e94122. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:28:08.181059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:28:08.184518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:28:08.310053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-623299153", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d78a8de-2c64-4044-abe6-4ba1346bd716"}], "security_groups": [{"name": "tempest-securitygroup--577694469"}], "key_name": "tempest-keypair-1131250624", "user_data": "}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:08.450271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9999091e-1c6e-4984-810f-20c11b639dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.932410 Aug 24 09:28:08.452083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 13/19] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:28:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:28:08.464777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8559024c-2d53-4452-b8ec-0891eca2aa5c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:08.465645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8559024c-2d53-4452-b8ec-0891eca2aa5c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:08.869572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8559024c-2d53-4452-b8ec-0891eca2aa5c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:08.928001 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8559024c-2d53-4452-b8ec-0891eca2aa5c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1212 microversion: 2.1 time: 0.467899 Aug 24 09:28:08.929389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 14/20] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:08 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1212 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:09.001489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] validate_networks() for [('2d78a8de-2c64-4044-abe6-4ba1346bd716', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:28:09.814965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-80773885-2fda-4982-84c8-9546677a6ffc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Action: 'create', calling method: .version_select at 0x7fa9182dbb80>, body: {"keypair": {"name": "tempest-keypair-38152476", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSaHUfLft3KeRBeMSwwAHXDE2ES+jZhUaQ56uGOPJF304zK8cN3ZYHkoyoC9hqwYgEYLviKyKiImLRcCuRxZo47vaNmxQ9Ig0PZb4hvuL+LYH6mB+icPGCaKqBd/4KLhA=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:09.935426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-80773885-2fda-4982-84c8-9546677a6ffc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for project 803ce13612e0460682ef8b4d42781a99. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:28:09.980245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-80773885-2fda-4982-84c8-9546677a6ffc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for user b9099dc3ad92431cbac98f144690038c and project 803ce13612e0460682ef8b4d42781a99. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:28:10.123837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-80773885-2fda-4982-84c8-9546677a6ffc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.537667 Aug 24 09:28:10.126442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 15/21] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 09:28:09 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:28:10.142701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5c0ae5dc-886a-4c11-b5f8-c227d1ed70c1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:10.143493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5c0ae5dc-886a-4c11-b5f8-c227d1ed70c1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:10.283180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5c0ae5dc-886a-4c11-b5f8-c227d1ed70c1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:10.293300 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5c0ae5dc-886a-4c11-b5f8-c227d1ed70c1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1212 microversion: 2.1 time: 0.165142 Aug 24 09:28:10.294605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 16/22] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:10 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1212 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:10.564908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:28:10.571000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:28:10.572755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:28:10.572755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:28:10.572755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:28:10.598295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:10.598812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:10.600763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:10.600763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:10.601194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:10.601783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:10.678356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:28:10.683948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:28:10.698579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:28:10.702909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:28:10.927941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1baf21f7-9ef4-4f7f-9da4-3284733e9d22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.633206 Aug 24 09:28:10.928586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 7/23] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:28:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 2635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:28:10.956106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3728c8af-69e7-4c40-b8a7-739277752f73 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:10.956106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3728c8af-69e7-4c40-b8a7-739277752f73 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:11.319968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3728c8af-69e7-4c40-b8a7-739277752f73 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:11.322289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:11.331319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:11.348482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:11.349613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:11.350036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:11.351322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:11.352052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3728c8af-69e7-4c40-b8a7-739277752f73 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1241 microversion: 2.1 time: 0.400555 Aug 24 09:28:11.352300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:11.352785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 17/24] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1241 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:11.369087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:11.713542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:11.742762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ff62077a-d7d7-42c4-a873-82147e95c47d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1216 microversion: 2.1 time: 0.427662 Aug 24 09:28:11.743932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 8/25] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:11 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1216 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:12.380764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e3db5a7c-0c7a-4e1f-b451-361eafb4456d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:12.381569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e3db5a7c-0c7a-4e1f-b451-361eafb4456d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:12.525618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e3db5a7c-0c7a-4e1f-b451-361eafb4456d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:12.543268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e3db5a7c-0c7a-4e1f-b451-361eafb4456d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1241 microversion: 2.1 time: 0.170359 Aug 24 09:28:12.544207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 18/26] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1241 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:12.763795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:12.764420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:12.782381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:12.784404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:12.786008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:12.786775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:12.787234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:12.787702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:12.890487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:12.914952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1c2c8301-631b-42a0-b5a0-f4faea058735 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1216 microversion: 2.1 time: 0.155142 Aug 24 09:28:12.917583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 9/27] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:12 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:13.290594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1024775484", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "570949e9-80a8-4560-b0ca-52af70ebdac6"}], "security_groups": [{"name": "tempest-securitygroup--1968557048"}], "key_name": "tempest-keypair-310762633", "user_data": "}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:13.566938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] validate_networks() for [('570949e9-80a8-4560-b0ca-52af70ebdac6', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:28:13.574205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:13.575145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:13.583047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:13.583776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:13.584683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:13.586068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:13.587165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:13.587864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:13.767859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:13.782718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-73855396-b5eb-43f4-b7db-d480c4cf3ef4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1245 microversion: 2.1 time: 0.221165 Aug 24 09:28:13.807708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 10/28] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1245 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:13.961665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:13.962710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:13.976726 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:13.978798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:13.987138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:13.987138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:13.987138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:13.987138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:14.159239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:14.173525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-51f71ff3-afe1-407f-ba2f-399bcb7eee1d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1264 microversion: 2.1 time: 0.218323 Aug 24 09:28:14.177056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 11/29] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:13 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:14.318611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:28:14.318611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:28:14.318611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:28:14.318611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:28:14.321511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:28:14.343698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:14.344553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:14.345151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:14.346339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:14.347176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:14.347880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:14.372261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:28:14.378267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for user cbcaa84bc9c54d7aa4178d0174a5936e and project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:28:14.397195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:28:14.405557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:28:14.527635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-910778498", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f82ab4fe-0b45-4012-bd34-d0cceb1c3651"}], "security_groups": [{"name": "tempest-securitygroup--1935285380"}], "key_name": "tempest-keypair-38152476", "user_data": "}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:14.617171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9f904f74-ef69-4b76-b28c-12f6d6a0f503 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.330656 Aug 24 09:28:14.636791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 19/30] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Aug 24 09:28:13 2022] POST /compute/v2.1/servers => generated 402 bytes in 1351 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 09:28:14.644706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a3198f2c-c54e-4c3e-9a25-108423242302 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:14.645568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a3198f2c-c54e-4c3e-9a25-108423242302 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:14.728030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3198f2c-c54e-4c3e-9a25-108423242302 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:14.740135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3198f2c-c54e-4c3e-9a25-108423242302 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:14.742066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3198f2c-c54e-4c3e-9a25-108423242302 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:14.743857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a3198f2c-c54e-4c3e-9a25-108423242302 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1281 microversion: 2.20 time: 0.105141 Aug 24 09:28:14.744592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 20/31] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1281 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:14.755928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] validate_networks() for [('f82ab4fe-0b45-4012-bd34-d0cceb1c3651', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:28:14.829947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:14.831151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:14.847794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:14.848320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:14.848776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:14.851080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:14.852031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:14.854882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:15.106234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:15.122266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d5fed9a8-7896-4364-a555-41b4dc78ae55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1245 microversion: 2.1 time: 0.302672 Aug 24 09:28:15.137714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 21/32] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1245 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:15.198948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:15.200629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:15.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:15.208453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:15.208896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:15.209635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:15.210092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:15.210516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:15.311850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:15.324514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ae8e36e2-3f56-4023-aa53-26f1ce01985a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1264 microversion: 2.1 time: 0.128251 Aug 24 09:28:15.331218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 22/33] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:15 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1264 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:15.365088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:28:15.365814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:28:15.366394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:28:15.366901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:28:15.367321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:28:15.377839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:15.378322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:15.378773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:15.379555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:15.380045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:15.380645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:15.406430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for project 803ce13612e0460682ef8b4d42781a99. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:28:15.412101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for user b9099dc3ad92431cbac98f144690038c and project 803ce13612e0460682ef8b4d42781a99. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:28:15.473364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:28:15.475671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:28:15.618838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-17a02cad-2d68-4b58-9a65-f5e680ea5a7d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.103315 Aug 24 09:28:15.625454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 12/34] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:28:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:28:15.632725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4c8fa428-0236-421e-962e-f6adc04105b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:15.635888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4c8fa428-0236-421e-962e-f6adc04105b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:15.745968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4c8fa428-0236-421e-962e-f6adc04105b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:15.756326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4c8fa428-0236-421e-962e-f6adc04105b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1235 microversion: 2.1 time: 0.128628 Aug 24 09:28:15.758135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 23/35] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:15 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1235 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:15.778457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2faefa2c-c694-4f2e-9d1d-1cea34fa1682 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:15.779828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2faefa2c-c694-4f2e-9d1d-1cea34fa1682 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:15.889172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2faefa2c-c694-4f2e-9d1d-1cea34fa1682 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:15.902740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2faefa2c-c694-4f2e-9d1d-1cea34fa1682 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:15.905304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2faefa2c-c694-4f2e-9d1d-1cea34fa1682 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:15.906721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2faefa2c-c694-4f2e-9d1d-1cea34fa1682 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1281 microversion: 2.20 time: 0.132595 Aug 24 09:28:15.920957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 13/36] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:15 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1281 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:16.147733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:16.147733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:16.154453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:16.155377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:16.155903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:16.156643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:16.157104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:16.166023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:16.266651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:16.275891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c401fa2c-fac4-49ac-b5aa-dad23af3ff8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1245 microversion: 2.1 time: 0.135665 Aug 24 09:28:16.276930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 24/37] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:16.346956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:16.348087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:16.356249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:16.360810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:16.360810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:16.360810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:16.360810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:16.361200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:16.442390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:16.450365 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2ca05126-e17f-4a79-b219-f631e8be9d83 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1264 microversion: 2.1 time: 0.107853 Aug 24 09:28:16.450981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 14/38] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:16 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1264 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:16.779257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58046f46-fdb1-49e1-9248-a82ba8e666a3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:16.779917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58046f46-fdb1-49e1-9248-a82ba8e666a3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:16.835924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-58046f46-fdb1-49e1-9248-a82ba8e666a3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:16.843823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58046f46-fdb1-49e1-9248-a82ba8e666a3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1235 microversion: 2.1 time: 0.068434 Aug 24 09:28:16.844388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 25/39] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:16 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1235 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:16.933639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:16.934902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:16.941589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:16.942103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:16.942537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:16.943245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:16.943722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:16.944148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:17.016161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:17.025863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:17.027387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:17.029434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bcf3c6ed-aa11-4a8d-a2db-7df8e6b1ad2a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1285 microversion: 2.20 time: 0.101737 Aug 24 09:28:17.030486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 15/40] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:16 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:17.298676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:17.299446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:17.313033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:17.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:17.313975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:17.314687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:17.315152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:17.315591 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:17.389191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:17.399816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3e4f30c5-f297-4308-8ca5-b89e73e5e231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1245 microversion: 2.1 time: 0.106431 Aug 24 09:28:17.419703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 26/41] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1245 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:17.470761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:17.472191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:17.482731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:17.482731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:17.482731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:17.482731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:17.483407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:17.483407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:17.551131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:17.559402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-de391f41-ec60-4bb0-8f56-09959ef12701 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1264 microversion: 2.1 time: 0.092425 Aug 24 09:28:17.560663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 16/42] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:17 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1264 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:17.874102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:17.876069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:17.895536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:17.895536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:17.895536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:17.898516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:17.899100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:17.901055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:18.016906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:18.025762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-344260dc-2f46-4ac3-b299-5ac9c2873e08 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1231 microversion: 2.1 time: 0.163806 Aug 24 09:28:18.026612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 27/43] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:17 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1231 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:18.055954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:18.056581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:18.063429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:18.064032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:18.064693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:18.065414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:18.065878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:18.066313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:18.144845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:18.155453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:18.160849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:18.162051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4a9d3ace-40b2-4446-90df-d94a72a363b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1277 microversion: 2.20 time: 0.110035 Aug 24 09:28:18.162879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 17/44] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:18.429236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:18.429955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:18.445121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:18.445636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:18.446251 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:18.447129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:18.447761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:18.448336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:18.579361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:18.582034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:18.585586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:18.587332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3c8bb5ff-5a15-47e7-b27d-efde170f954e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1293 microversion: 2.1 time: 0.166105 Aug 24 09:28:18.587936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 28/45] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1293 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:18.589579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:18.590076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:18.590522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:18.591234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:18.591722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:18.592338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:18.657463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:18.665231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4fa94eb2-a04f-4d26-abc2-4ef4c8b48d79 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1270 microversion: 2.1 time: 0.087967 Aug 24 09:28:18.666344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 18/46] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:18 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:19.052860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:19.053795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:19.068186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.079471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.079471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:19.079471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.079471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.079819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:19.220302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:19.221081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:19.224890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:19.234375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ebabdfd5-48aa-4a7b-99e7-a5ae3a301663 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1287 microversion: 2.1 time: 0.186626 Aug 24 09:28:19.239519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 29/47] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:19 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1287 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:19.276629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.291232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.296953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:19.313839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.314711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.316548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:19.609837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:19.609837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:19.618318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.632177 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.637946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:19.637946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.637946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.637946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:19.805296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:19.823257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:19.831398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:19.840066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ca0cc8e0-311f-4e51-b650-fe59e3f384bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1341 microversion: 2.20 time: 0.624455 Aug 24 09:28:19.854415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 19/48] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1341 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:19.864727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:19.869406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:19.870894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:19.900385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-64af52dd-b363-4269-955e-f22df8122376 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1311 microversion: 2.1 time: 0.296550 Aug 24 09:28:19.901258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 30/49] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1311 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:19.922447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.923750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.924481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:19.925404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:19.926108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:19.926760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:20.265058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:20.265772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:20.271777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:20.277346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:20.277346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:20.277346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:20.277346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:20.277709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:20.447617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:20.459354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5ba714ec-96cb-4bf0-b6dc-35aacadba3a4 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1293 microversion: 2.1 time: 0.199225 Aug 24 09:28:20.460978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 31/50] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:20 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1293 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:20.555367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:20.566173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6122ec49-7d1a-4319-9efd-f1c19ed5c4d5 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.720607 Aug 24 09:28:20.580221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 20/51] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:19 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:20.871524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:20.872206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:20.881504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:20.881998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:20.882426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:20.888281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:20.888838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:20.889712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:20.934057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:20.940573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:20.969672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:20.970825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:20.972583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:20.974866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:20.976219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:20.979384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:21.135948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:21.150523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:21.154787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:21.159775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c941be28-46d3-4cb7-9cbf-4cf4a5efb414 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1339 microversion: 2.20 time: 0.292311 Aug 24 09:28:21.161945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 32/52] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1339 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:21.318225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:21.344756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-19bab77f-07c4-4453-b870-f63dccf2dd3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1299 microversion: 2.1 time: 0.418657 Aug 24 09:28:21.367706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 21/53] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1299 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:21.484263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:21.484918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:21.495206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:21.502099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:21.502099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:21.502099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:21.502099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:21.503023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:21.595640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:21.596449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:21.623063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:21.623854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:21.624620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:21.628943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:21.633979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:21.640112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:21.757523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:21.771843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2e3e41df-f221-4344-8b76-85cb322f6ddb tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1293 microversion: 2.1 time: 0.282889 Aug 24 09:28:21.775574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 33/54] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:21 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1293 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:22.184234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:22.185888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:22.201046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.203125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.203815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.210314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.211133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.212091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.432421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:22.446728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-90c3d61f-2f6e-469a-8a34-e927e91da206 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.856624 Aug 24 09:28:22.471016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 22/55] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:21 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:22.471016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:22.471016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:22.490639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.491212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.492733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.493547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.496934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.498306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.776152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:22.786484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:22.788631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:22.793513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f1d92c53-c678-4189-a3af-f73c36243033 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.610411 Aug 24 09:28:22.793513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 34/56] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:22.832760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:22.841793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-422d335b-5ff0-43db-addb-2fb639a2f3f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.386037 Aug 24 09:28:22.843535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 23/57] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:22.858157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:22.858810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:22.865104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.865815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.875840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.876718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.877265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.877659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.917568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-1ba92979-3184-41f3-afe6-fd3cfac5333f req-840c0f73-4f7c-45d4-91c1-3f1f4f663a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf", "tag": "d5c544d0-346e-4b82-b925-01de0d3a61e1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:22.926756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:22.935963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-1ba92979-3184-41f3-afe6-fd3cfac5333f req-840c0f73-4f7c-45d4-91c1-3f1f4f663a05 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.955817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-1ba92979-3184-41f3-afe6-fd3cfac5333f req-840c0f73-4f7c-45d4-91c1-3f1f4f663a05 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.955817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-1ba92979-3184-41f3-afe6-fd3cfac5333f req-840c0f73-4f7c-45d4-91c1-3f1f4f663a05 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.958009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-1ba92979-3184-41f3-afe6-fd3cfac5333f req-840c0f73-4f7c-45d4-91c1-3f1f4f663a05 service nova] Creating event network-changed:d5c544d0-346e-4b82-b925-01de0d3a61e1 for instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf on hv-cinder-85032 Aug 24 09:28:22.958550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-1ba92979-3184-41f3-afe6-fd3cfac5333f req-840c0f73-4f7c-45d4-91c1-3f1f4f663a05 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 09:28:22.958951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-1ba92979-3184-41f3-afe6-fd3cfac5333f req-840c0f73-4f7c-45d4-91c1-3f1f4f663a05 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 09:28:22.960032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.960494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.960929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.961654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:22.962370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:22.962792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:22.972324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.compute.rpcapi [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 09:28:22.973318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] Releasing lock "compute-rpcapi-router" {{(pid=121142) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 09:28:23.012528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e0200d96-330c-4023-84e2-d73a62eaef19 None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215604 Aug 24 09:28:23.012528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 35/58] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:28:23.048665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:23.056954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-647aeee4-b549-4099-913b-97ccc092d178 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.212147 Aug 24 09:28:23.067275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 24/59] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:22 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:23.478010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:23.478749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:23.485686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:23.486371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:23.486972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:23.487904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:23.488529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:23.488951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:23.631952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:23.643088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58e40a76-dec0-4159-9726-640902add3a0 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.169053 Aug 24 09:28:23.644332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 36/60] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:23 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:23.822902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:23.824853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:23.830337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:23.830762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:23.831197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:23.831983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:23.832438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:23.832866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:23.864877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:23.865508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:23.871460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:23.872000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:23.872979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:23.873677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:23.874128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:23.874558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:24.036452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:24.042816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:24.043099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:24.046283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:24.047837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:24.049523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-500390ca-6c12-47b5-b401-319975482000 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.188406 Aug 24 09:28:24.049640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3efb2e4f-fedf-453f-a4ea-309869332256 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.230602 Aug 24 09:28:24.050090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 37/61] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:24.050220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 25/62] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:24.078108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:24.078749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:24.084932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:24.085367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:24.085808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:24.086500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:24.087215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:24.087672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:24.225457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:24.229506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2d28ae12-25ed-4865-8adb-ba058a363804 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.155695 Aug 24 09:28:24.230147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 26/63] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:24 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:24.664321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:24.664859 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:24.670878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:24.671360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:24.671833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:24.672528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:24.672985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:24.673415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:24.823053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:24.829009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5b91e90f-b503-406c-ae02-c8323e856935 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.168514 Aug 24 09:28:24.831772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 38/64] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:24 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:25.073627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:25.074440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:25.074846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:25.074945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:25.080972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:25.081358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.082182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.082321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.083012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.083272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.083463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.083917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.084012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.089206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:25.090282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.092447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.093058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.094573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.236812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:25.248588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:25.250689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:25.252263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3a912616-10c8-42ad-9a4c-008c4b0b94ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.184007 Aug 24 09:28:25.253399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 39/65] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:25.258345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:25.259148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:25.266841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.267554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.268233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.269106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.269563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.270144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.287091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:25.309791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-45e7c1c1-8dc9-42b8-b961-4eb03013c364 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.243227 Aug 24 09:28:25.310881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 27/66] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:25.454681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:25.469833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6e48141b-bea7-4dfa-ae53-a58feac0ac4a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.215138 Aug 24 09:28:25.470414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 40/67] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:25 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:25.850930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:25.851441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:25.854271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=4 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:25.859281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.859919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.860418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.861135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:25.861660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:25.862288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:25.905055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=22 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:26.021440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:26.029681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8a5409d0-f128-4683-86bf-91694d4dcdeb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.183092 Aug 24 09:28:26.030366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 28/68] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:25 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:26.278263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:26.278916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:26.285885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:26.286399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:26.286847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:26.287570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:26.288054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:26.288482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:26.334709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:26.335576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:26.344030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:26.344659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:26.345160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:26.345925 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:26.346530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:26.347016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:26.435057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:26.445418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:26.447699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:26.449183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-262493b2-c55f-4de6-9897-821ab8585f12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.174757 Aug 24 09:28:26.449754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 41/69] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:26.488732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:26.496884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:26.501062 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:26.501192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2381646b-81cd-4719-ba5a-2946c5c3e93d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.172043 Aug 24 09:28:26.501558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 29/70] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:26.504771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:26.505327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:26.505774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:26.506484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:26.506925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:26.507351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:26.635252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:26.643075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3a35da29-557e-4ad0-b32c-46ca16e9f9ce tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.150143 Aug 24 09:28:26.643686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 42/71] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:26 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:27.058314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:27.058314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:27.058314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.058314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.058610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.059252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.060311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.060744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.190011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:27.198008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b244e2fe-4793-4425-bcca-084762fddca2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.150729 Aug 24 09:28:27.198579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 30/72] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:27 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:27.477218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:27.477837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:27.479711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=30 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:27.485216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.485693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.486126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.486845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.487363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.487810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.539155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:27.540102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:27.552788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.553772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.554438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.555520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.556519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.557508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.708928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:27.718054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7b9d4554-89fd-4a5f-9f86-cd5118ae98a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.195267 Aug 24 09:28:27.718976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 31/73] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:27.732368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:27.733281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:27.748882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.749479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.749988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.750830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:27.751358 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:27.751952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:27.815185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:27.825824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:27.827876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:27.829285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-18e9b57d-ea45-4151-b0c1-f9492db92659 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.355891 Aug 24 09:28:27.829910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 43/74] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:27.904601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:27.913674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-84381467-0e90-46c2-9295-716df44b3067 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.193344 Aug 24 09:28:27.914470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 32/75] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:27 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:28.219010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:28.219646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:28.225799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.226275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.226709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:28.227396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.227879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.228304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:28.353432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:28.361492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6b3a2f60-822e-42fe-bc0f-3cf4b5506cf6 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.146855 Aug 24 09:28:28.362048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 44/76] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:28 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:28.739077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:28.739728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:28.745702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.746176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.746608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:28.747286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.747829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.748812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:28.859559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:28.860206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:28.866278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.866818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.867311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:28.868211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.868697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.869124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:28.892228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:28.905300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-968fba7d-c685-4d0f-893e-445c11bb7317 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.168583 Aug 24 09:28:28.906718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 33/77] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:28.934751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:28.935464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:28.942874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.943364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.943946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:28.944683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:28.945138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:28.945568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:29.039333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:29.049369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:29.050800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:29.052019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0de13dc9-feac-404e-be6b-fd67b6be7148 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.202017 Aug 24 09:28:29.067351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 45/78] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:28 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:29.102422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:29.110694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8dbf548f-908a-4ca4-99b5-4e7261b7375c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.180122 Aug 24 09:28:29.111286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 34/79] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:28 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:29.393098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:29.393748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:29.402348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:29.403168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:29.403809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:29.405270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:29.405951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:29.406525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:29.545614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:29.556700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-980548c2-f77f-4962-828b-5da980103cfa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.172529 Aug 24 09:28:29.561088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 46/80] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:29 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:29.928241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:29.928873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:29.937374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:29.938344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:29.938991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:29.940226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:29.941062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:29.941758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:30.074962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:30.075623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:30.088468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:30.094536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:30.095332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:30.096409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:30.097016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:30.110500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:30.110779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:30.116447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a9036924-b816-44ba-892d-79a7c77398bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.193042 Aug 24 09:28:30.131338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 35/81] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:30.137367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:30.143644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:30.145410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:30.145911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:30.146398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:30.147114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:30.147570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:30.148022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:30.308096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:30.319733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e1cb0efe-b11a-4d0a-9299-33ac6ffc3a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.186968 Aug 24 09:28:30.321328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 36/82] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:30 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:30.386482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:30.395175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:30.396933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:30.398058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1c725b64-9e5b-4f88-87a5-1a7cb7d3a6d5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.327497 Aug 24 09:28:30.398615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 47/83] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:30 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:30.579163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:30.579914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:30.585961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:30.586443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:30.587144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:30.587855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:30.594229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:30.595467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:30.803436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:30.811629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9b29a8d9-f030-47e9-a137-b53456ac7425 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.236953 Aug 24 09:28:30.814253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 37/84] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:30 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:31.138294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:31.140219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:31.149117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.152597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.152597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:31.152597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.152597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.152928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:31.317008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:31.325312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5bfd5391-406e-42e4-8ecb-77a95a8e7c69 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.191085 Aug 24 09:28:31.325812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 48/85] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:31.341470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:31.342235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:31.348324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.348809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.349249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:31.349948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.350408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.350847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:31.422021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:31.428254 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:31.434674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.435284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.436775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:31.437610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.438301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.438909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:31.532450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:31.541641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f230c6e5-7102-47e8-8093-c0ba867a1bb8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.203753 Aug 24 09:28:31.560047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 38/86] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:31 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:31.665629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:31.707332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:31.707332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:31.707332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-60ed852d-3b70-40a0-8a2a-24cb8eb08c12 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.258994 Aug 24 09:28:31.707705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 49/87] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:31.838232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:31.838804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:31.845650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.846174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.846658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:31.847344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:31.847825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:31.848320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:32.021491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:32.029543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-52333101-9f88-4a6b-8791-44caab5f7ccc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.195525 Aug 24 09:28:32.030120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 39/88] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:31 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:32.348096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:32.348746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:32.355151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:32.355958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:32.356574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:32.357325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:32.357783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:32.358509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:32.520806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:32.529507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5c07e8a3-cbc9-4803-a124-808a762f11a8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.185313 Aug 24 09:28:32.543738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 50/89] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:32.571703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:32.572363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:32.579127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:32.579630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:32.580111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:32.580864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:32.581367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:32.581844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:32.714692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:32.715475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:32.723297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:32.723827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:32.724450 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:32.725305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:32.725936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:32.726678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:32.733911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:32.741977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6968cfb2-2001-4583-b63d-f14086aa86a9 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.174281 Aug 24 09:28:32.742810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 40/90] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:32 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:32.860645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:32.868701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:32.870198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:32.871328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cba8c157-493c-4ba0-8fa4-0a42280eb1cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.161672 Aug 24 09:28:32.871924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 51/91] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:33.050167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:33.050793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:33.056852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.057340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.057780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.058477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.058936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.059403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.187215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:33.194886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-796ce5c1-b0a3-4c89-afa6-9b8ff59e64f8 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.148664 Aug 24 09:28:33.195438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 41/92] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:33 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:33.551236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:33.551929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:33.553685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:33.558430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.558910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.559342 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.560062 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.560577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.561003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.692232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:33.699693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ffb1f08b-ec1f-440f-9763-f132437e0994 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.152191 Aug 24 09:28:33.700255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 52/93] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:33.762243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:33.762886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:33.769043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.769530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.769969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.770664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.771121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.771547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.789099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:33.893244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:33.893863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:33.899049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:33.899992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.900474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.900913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.901614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:33.902071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:33.902500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:33.907417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-95c6bdac-fe24-4260-9e87-1a3c3e6cba2b tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.149019 Aug 24 09:28:33.908026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 42/94] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:33 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:34.027468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:34.036017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:34.037519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:34.038622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7748370f-097c-4480-9772-8af9871ca307 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.149326 Aug 24 09:28:34.039179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 53/95] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:34.215747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:34.217072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:34.223192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:34.223712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:34.224156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:34.224860 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:34.225321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:34.225750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:34.351404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:34.359413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2c42d3a3-8df5-437a-b817-31aa8fad14df tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.147804 Aug 24 09:28:34.360132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 43/96] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:34 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:34.721019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:34.721630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:34.727544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:34.728061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:34.728501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:34.729194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:34.729650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:34.730078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:34.858401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:34.865974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-21a94bdd-fe69-43c1-86bb-7c828e904d67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.149297 Aug 24 09:28:34.866533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 54/97] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:34.928213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:34.928825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:34.934642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:34.935117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:34.936092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:34.936774 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:34.937221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:34.937643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:35.065186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:35.066624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:35.067263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:35.072991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f7ef9137-19d5-47a8-a959-78940bd718a0 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.148550 Aug 24 09:28:35.073216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:35.073553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 44/98] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:34 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:35.073691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:35.074121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:35.074880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:35.075333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:35.076380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:35.204679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:35.208048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:35.213197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:35.214716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:35.215884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ebb7e787-94f0-4d1c-895c-4cf93bad2215 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.153331 Aug 24 09:28:35.227264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 55/99] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:35 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:35.380062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:35.380649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:35.386519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:35.387259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:35.387418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:35.388134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:35.389160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:35.389589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:35.516544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:35.524632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-69346df9-5abe-4ace-b9d5-175e8fa10b4c tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.148387 Aug 24 09:28:35.525392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 45/100] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:35 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:35.886308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:35.886916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:35.892808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:35.893281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:35.893709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:35.894383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:35.894824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:35.895242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:36.019010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:36.026367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bdf63ad8-efa3-4043-be59-cefc72b40df4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.144157 Aug 24 09:28:36.026927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 56/101] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:36.094790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:36.095328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:36.101274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:36.101747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:36.102173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:36.102852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:36.103296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:36.103742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:36.226920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:36.234605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-118cb2f0-ecb1-4bb8-b414-7fb9bd7b6c0c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.144295 Aug 24 09:28:36.235174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 46/102] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:36 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:36.238564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:36.239167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:36.244999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:36.245467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:36.245895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:36.246568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:36.247009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:36.247425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:36.377049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:36.385208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:36.386705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:36.387836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e8dea3e8-9467-495b-9201-73d9707b9cce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.153100 Aug 24 09:28:36.389003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 57/103] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:36 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:36.546965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:36.547638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:36.553915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:36.554407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:36.554851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:36.555552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:36.556045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:36.556480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:36.697029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:36.705385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f9934dfb-5815-4dcb-bd88-bd5b34f8840f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.163020 Aug 24 09:28:36.705971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 47/104] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:36 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:37.046960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:37.050737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:37.053721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.054205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.054744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.055432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.055917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.056347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.182182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:37.190362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-24f6eaf8-eb40-4b7d-b642-05d6eaace6d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.147977 Aug 24 09:28:37.190915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 58/105] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:37.254049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:37.254663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:37.260551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.261037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.261475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.262165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.262621 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.263050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.389753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:37.397326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4a8cb8a3-8bb7-4a10-b6bf-279b1b7e8dfc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.147053 Aug 24 09:28:37.397882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 48/106] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:37 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:37.410701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:37.411304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:37.417148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.417620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.418046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.418722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.419165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.419610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.546962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:37.555093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:37.556609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:37.557702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ea067af1-5a68-47aa-94b2-6a19917ace80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.150858 Aug 24 09:28:37.558253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 59/107] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:37 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:37.726104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:37.726718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:37.732608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.733093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.733538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.734229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:37.734688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:37.735116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:37.867276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:37.875396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7df159d3-108e-46cb-bd5a-63710425089a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.153096 Aug 24 09:28:37.875990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 49/108] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:37 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:38.210350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:38.210907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:38.217104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.217680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.218093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:38.218791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.219218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.219668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:38.345919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:38.353920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-64696787-4688-4d84-aeb1-93669e30be44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.147555 Aug 24 09:28:38.354878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 60/109] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:38.417772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:38.418607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:38.425732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.426221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.426654 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:38.427355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.427834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.439310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:38.557140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:38.564876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6416787d-26ed-493f-8342-37096f7f7e01 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.150852 Aug 24 09:28:38.565842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 50/110] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:38 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:38.579864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:38.580480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:38.586272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.587018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.587461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:38.588189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.588768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.589200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:38.725554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:38.734074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:38.735403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:38.736623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-172e1de0-80ee-4af5-b12d-83b73d56acb2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.160867 Aug 24 09:28:38.737174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 61/111] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:38 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:38.896652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:38.897255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:38.903087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.903563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.904588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:38.905281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:38.905802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:38.906218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:39.293966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:39.308987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-041d1a72-b18f-4bfa-96e0-033bd7362452 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.416191 Aug 24 09:28:39.309729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 51/112] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:38 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:39.375222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:39.376960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:39.383663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:39.384371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:39.384965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:39.385857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:39.386824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:39.387627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:39.589564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:39.590853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:39.600199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:39.600909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:39.602155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:39.603145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:39.603781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:39.604382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:39.740164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:39.752713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0edfba8e-8488-42b0-a80f-f94ff276925f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.381876 Aug 24 09:28:39.764404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 62/113] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:39.772680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:39.773673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:39.780607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:39.781377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:39.781987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:39.783070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:39.783707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:39.784272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:39.930847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:39.940711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f9465e92-01fb-47d4-9356-07242609e638 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.358246 Aug 24 09:28:39.943930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 52/114] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:39 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:40.281351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:40.291207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:40.296598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:40.303292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e8d9c928-497d-47ce-bfa0-cb0c6c549d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.537541 Aug 24 09:28:40.304227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 63/115] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:40.331165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:40.331810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:40.341675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.342163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.344176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.344176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.344176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.345138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.543747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:40.556343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ed67b3ab-6b64-4721-ad86-ec6943eb1e57 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.229612 Aug 24 09:28:40.560423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 53/116] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:40 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:40.740467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-8f780af0-8d09-4060-a286-36ff695f2b35 req-f81840c7-2043-494a-8e76-99ee5206b0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e093c82-b762-45aa-840b-26b6b982f8bc", "tag": "c90b8067-74c1-43cb-b490-fe8f8d77018f"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:40.770544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8f780af0-8d09-4060-a286-36ff695f2b35 req-f81840c7-2043-494a-8e76-99ee5206b0ad service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.770544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8f780af0-8d09-4060-a286-36ff695f2b35 req-f81840c7-2043-494a-8e76-99ee5206b0ad service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.770544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8f780af0-8d09-4060-a286-36ff695f2b35 req-f81840c7-2043-494a-8e76-99ee5206b0ad service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.813332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-8f780af0-8d09-4060-a286-36ff695f2b35 req-f81840c7-2043-494a-8e76-99ee5206b0ad service nova] Creating event network-changed:c90b8067-74c1-43cb-b490-fe8f8d77018f for instance 9e093c82-b762-45aa-840b-26b6b982f8bc on hv-cinder-85032 Aug 24 09:28:40.814261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8f780af0-8d09-4060-a286-36ff695f2b35 req-f81840c7-2043-494a-8e76-99ee5206b0ad service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121141) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 24 09:28:40.814980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8f780af0-8d09-4060-a286-36ff695f2b35 req-f81840c7-2043-494a-8e76-99ee5206b0ad service nova] Acquired lock "compute-rpcapi-router" {{(pid=121141) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 24 09:28:40.816384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.817063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.817802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.818706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.819470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.820224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.830641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.compute.rpcapi [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 24 09:28:40.832005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] Releasing lock "compute-rpcapi-router" {{(pid=121141) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 24 09:28:40.864671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1ca9e840-9117-4c07-83e5-ca2dbac0f65e None None] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127752 Aug 24 09:28:40.865217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 54/117] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:28:40.869405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-08a4e326-e075-4127-9d28-fa9a4dac3b33 req-16102940-f95f-4d6c-bdd7-57f5dd0bd71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb650451-50be-4714-b442-2a6cbcf96d6d", "tag": "b99cb60a-57da-4793-a9df-1b6184d7afdb"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:40.876951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:40.877593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:40.890341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.890842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.893134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.895384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.896185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.896788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.899567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-08a4e326-e075-4127-9d28-fa9a4dac3b33 req-16102940-f95f-4d6c-bdd7-57f5dd0bd71a service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.900517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-08a4e326-e075-4127-9d28-fa9a4dac3b33 req-16102940-f95f-4d6c-bdd7-57f5dd0bd71a service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.901502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-08a4e326-e075-4127-9d28-fa9a4dac3b33 req-16102940-f95f-4d6c-bdd7-57f5dd0bd71a service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.919051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-08a4e326-e075-4127-9d28-fa9a4dac3b33 req-16102940-f95f-4d6c-bdd7-57f5dd0bd71a service nova] Creating event network-changed:b99cb60a-57da-4793-a9df-1b6184d7afdb for instance eb650451-50be-4714-b442-2a6cbcf96d6d on hv-cinder-85032 Aug 24 09:28:40.926837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-08a4e326-e075-4127-9d28-fa9a4dac3b33 req-16102940-f95f-4d6c-bdd7-57f5dd0bd71a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.208215 Aug 24 09:28:40.928292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 64/118] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:28:40.973858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:40.973858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:40.980256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.981894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.982627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:40.984429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:40.985233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:40.985936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:41.115371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:41.135828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:41.146933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68355f5b-c52c-41e1-b6c0-3cc0ccba9028 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.187706 Aug 24 09:28:41.150217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0668b7ab-4b6c-450a-b16c-f358f62b6c34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.283804 Aug 24 09:28:41.155271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 55/119] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:41.160439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 65/120] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:40 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:41.328950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:41.329514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:41.340769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:41.340769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:41.340769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:41.340769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:41.344499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:41.344990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:41.581846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:41.582465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:41.590192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:41.591079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:41.591960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:41.593008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:41.594030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:41.594746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:41.679528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:41.704951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:41.709174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:41.712151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d1a61ee7-840c-4bff-990c-61d812b668e4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.385584 Aug 24 09:28:41.728460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 56/121] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:41 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:41.786804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:41.796222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eae070d9-0f2f-4477-91e8-b4ab20ba7f97 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.217294 Aug 24 09:28:41.807929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 66/122] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:41 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:42.167810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:42.169079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:42.179635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:42.181006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:42.190155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.190396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.190837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.191555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.191700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.192148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.192725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.193376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.193738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.193843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.194398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.194963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.347012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:42.355236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9ffa5edd-aaf7-455a-b1ab-2b47b2dc34b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.179499 Aug 24 09:28:42.356295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 67/123] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:42.396666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:42.404834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b6b18368-dc87-433f-9a7b-474b65cc1213 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.240829 Aug 24 09:28:42.405413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 57/124] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:42 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:42.738959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:42.741042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:42.748727 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.749516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.749958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.750793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.751333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.751811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.820979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:42.821589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:42.837050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.837050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.837050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.837050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.838984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.841327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:42.906240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:42.914850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:42.916902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:42.918347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4a975230-be60-4545-85d1-52ea0b0e6420 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.185583 Aug 24 09:28:42.919596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 68/125] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:42 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:42.983814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-58b5702e-fdb2-4e7e-a35f-40d263c87a23 req-4cf84418-fe7d-4816-b01b-574b08b4ac79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c65cee-4bde-44b8-844d-9f4a6aac5208", "tag": "b54629e7-4228-4772-903b-0ba66d767332"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:42.993661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-58b5702e-fdb2-4e7e-a35f-40d263c87a23 req-4cf84418-fe7d-4816-b01b-574b08b4ac79 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:42.994248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-58b5702e-fdb2-4e7e-a35f-40d263c87a23 req-4cf84418-fe7d-4816-b01b-574b08b4ac79 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:42.994736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-58b5702e-fdb2-4e7e-a35f-40d263c87a23 req-4cf84418-fe7d-4816-b01b-574b08b4ac79 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:43.010492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-58b5702e-fdb2-4e7e-a35f-40d263c87a23 req-4cf84418-fe7d-4816-b01b-574b08b4ac79 service nova] Creating event network-changed:b54629e7-4228-4772-903b-0ba66d767332 for instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 on hv-cinder-85032 Aug 24 09:28:43.017157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-58b5702e-fdb2-4e7e-a35f-40d263c87a23 req-4cf84418-fe7d-4816-b01b-574b08b4ac79 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037323 Aug 24 09:28:43.018474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 69/126] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:28:43.031478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:43.044289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ac5f0d84-5f25-48d3-a2bd-56e843b9357a tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.227864 Aug 24 09:28:43.046031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 58/127] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:42 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:43.377031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:43.377813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:43.384446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:43.384932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:43.385367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:43.386332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:43.386681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:43.387103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:43.426174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:43.426767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:43.434578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:43.434578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:43.438044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:43.438641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:43.439098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:43.439519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:43.464848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:43.582622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:43.590586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-79f82f51-a7a5-4acf-8b70-ac5d3958d08c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.168181 Aug 24 09:28:43.593086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 59/128] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:43 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:43.620026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:43.631178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-17e5205d-50b9-4892-9f9f-17a2de85f267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.256417 Aug 24 09:28:43.631178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 70/129] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:43.945630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:43.946340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:43.952468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:43.952948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:43.953383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:43.954069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:43.954520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:43.954943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:44.068690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:44.070094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:44.079515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:44.080309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:44.080958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:44.081877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:44.082655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:44.083412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:44.095894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:44.104432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:44.106252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:44.107699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6af9932c-21cd-424f-8910-6fc35cde4b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.166271 Aug 24 09:28:44.108578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 60/130] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:44.242857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:44.250508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4fa2ef6c-5634-4dc8-b793-98b731eb5080 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.186516 Aug 24 09:28:44.256385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 71/131] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:44 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:44.611728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:44.612346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:44.618166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:44.622346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:44.622346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:44.622346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:44.622346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:44.622794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:44.649513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:44.657415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:44.657415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:44.658184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:44.658694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:44.660033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:44.660788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:44.661422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:44.796542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:44.807500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1bf04d11-8344-4162-8521-64d2b2581c95 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.199435 Aug 24 09:28:44.822907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:44.823041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 61/132] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:44 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:44.829511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-329cc3d9-c1be-4af9-8293-2668a8bf9688 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.184263 Aug 24 09:28:44.830077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 72/133] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:45.130711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:45.131320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:45.139123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.139837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.140276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:45.141331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.148905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.149368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:45.278529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:45.281880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:45.285666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.286773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.287617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:45.288461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.289083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.289680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:45.315904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:45.332715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:45.334784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:45.335936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d4860407-7d4d-43cd-ade0-55b2a09f4b76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.209543 Aug 24 09:28:45.337765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 62/134] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:45.446999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:45.450701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:45.456583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-054d316c-85ac-4a0b-b11f-72186b79517e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.183070 Aug 24 09:28:45.457160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 73/135] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:45 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:45.830539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:45.832573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:45.839856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.840528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.841602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:45.842562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.851001 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:45.851641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:45.859345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.859936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:45.867173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.867990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.868580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:45.869439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:45.870043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:45.870637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:46.084907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:46.096147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-16da8904-9cf3-4ada-980d-849cce8e37da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.248665 Aug 24 09:28:46.108281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 74/136] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:46.119972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:46.129535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4cfd0892-badc-427a-a54d-461bd5321dd2 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.303824 Aug 24 09:28:46.130332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 63/137] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:45 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:46.360772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:46.361294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:46.367366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:46.367988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:46.368495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:46.369260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:46.369787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:46.370284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:46.478199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:46.478805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:46.486663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:46.487156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:46.487610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:46.488315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:46.488769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:46.489192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:46.527265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:46.535561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:46.537316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:46.538436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0a4b1540-9189-41db-a05f-8e522aac7f8a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.182288 Aug 24 09:28:46.539016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 75/138] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:46.632627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:46.641332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fb882e71-3b70-4905-b5e1-8c468769fb81 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.166887 Aug 24 09:28:46.642224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 64/139] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:46 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:47.116532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:47.117169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:47.123559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.124082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.124501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.125189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.125639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.126061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.152460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:47.153136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:47.159349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.159959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.160464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.161250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.162531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.163061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.259296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:47.269233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58dcb3fb-77ec-41c1-ba95-8f98d9133245 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.156511 Aug 24 09:28:47.269803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 76/140] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:47.361205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:47.370407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c3a69706-3b5f-4c71-845c-afdac8cba20a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.221752 Aug 24 09:28:47.370997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 65/141] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:47 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:47.564307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:47.564940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:47.570775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.571251 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.571740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.572406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.572852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.573266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.664533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:47.664533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:47.671103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.671663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.672103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.672811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:47.673264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:47.673686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:47.721023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:47.729899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:47.731398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:47.733112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e2f5e9df-dda4-456b-b13f-79753f212699 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.172910 Aug 24 09:28:47.747801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 77/142] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:47 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:47.812354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:47.820534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-becdc9ba-e7e6-4ff9-83b5-a30a83c9d5d4 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.161340 Aug 24 09:28:47.822102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 66/143] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:47 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:48.290095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:48.290707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:48.296943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.297409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.297837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:48.298521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.299006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.299423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:48.397556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:48.398170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:48.404473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.405164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.405371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:48.406061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.406499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.406918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:48.439445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:48.447447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-baf15adc-1f33-49eb-b6fb-d4594b4ed5e7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.161205 Aug 24 09:28:48.448134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 78/144] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:48.689234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:48.697993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-af94786d-188e-47fd-ab96-5ed33a50d600 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.304086 Aug 24 09:28:48.698848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 67/145] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:48 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:48.756266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:48.756452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:48.762412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.763005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.763539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:48.764294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.764743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.765231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:48.845967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:48.846895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:48.856396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.857789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.859391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:48.860824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:48.861810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:48.862756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:49.055574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:49.071151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a67d48c6-ffaa-4d59-a916-fa27423559cd tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.228182 Aug 24 09:28:49.071151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 68/146] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:48 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:49.348483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:49.357190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:49.358899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:49.360160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e5ebeec6-0a88-40a5-96d9-4160f3dc7f63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.608278 Aug 24 09:28:49.360807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 79/147] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:48 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:49.468776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:49.469381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:49.475438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:49.475993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:49.476533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:49.482275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:49.482275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:49.482275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:49.617256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:49.625120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ec9a7376-217b-496d-9fe6-1de0ab437c25 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.160426 Aug 24 09:28:49.625697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 69/148] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:49.721868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:49.722554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:49.731166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:49.732443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:49.732944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:49.733836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:49.734553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:49.734981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:49.905985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:49.914031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-04d45bbb-0672-4fa4-af06-eef4ab6e23b6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.196720 Aug 24 09:28:49.914610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 80/149] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:49 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:50.090583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:50.091387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:50.097646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.098195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.098637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:50.099775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.100303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.100784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:50.247052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:50.255857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-619b388d-942d-4ee3-af5b-a6b0c12c85bc tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.169484 Aug 24 09:28:50.256454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 70/150] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:50 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:50.384074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:50.384594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:50.391968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.392456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.392898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:50.393592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.399332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.399332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:50.531421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:50.540068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:50.541668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:50.547615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4d41d2c7-04a4-45dd-b719-c2d3e381003d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.162713 Aug 24 09:28:50.547615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 81/151] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:50 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:50.645450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:50.645975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:50.651820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.652308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.652737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:50.653495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.653938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.654357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:50.794993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:50.803002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e0a3495f-67b5-4189-ba01-25e504cf5899 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.161489 Aug 24 09:28:50.803567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 71/152] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:50.934134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:50.934740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:50.940476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.940962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.941403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:50.942094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:50.942549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:50.942977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:51.100521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:51.109533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-272af02d-ade1-42d6-abf5-01cc2a179f06 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.179173 Aug 24 09:28:51.110124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 82/153] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:50 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:51.277484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:51.279028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:51.286032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:51.286497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:51.286990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:51.287973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:51.289013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:51.289944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:51.290377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:51.507728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:51.519788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-969e2615-6e49-45f1-8d63-b0ef403656b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.246035 Aug 24 09:28:51.528481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 72/154] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:51 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:51.565956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:51.566582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:51.578253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:51.583721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:51.583721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:51.583721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:51.583721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:51.584395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:51.824488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:51.825157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:51.838388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:51.838888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:51.839330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:51.842205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:51.844405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:51.848259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:51.880996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:51.894096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:51.895786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:51.897264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fca65a80-63b7-4e06-9e62-fc711c65ea9d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.335447 Aug 24 09:28:51.898379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 83/155] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:51 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:52.076210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:52.085234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3052e0e1-d0ad-4b96-9118-8ca1641f671c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.264554 Aug 24 09:28:52.086476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 73/156] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:52.130430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:52.131060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:52.136996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:52.137478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:52.138501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:52.139195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:52.139702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:52.145257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:52.271117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:52.279221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-008cfa7d-195c-4838-884f-2778b59eac69 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.152530 Aug 24 09:28:52.280001 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 84/157] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:52 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:52.473710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-6123162e-fcfc-4b30-920c-0d50f6e33559 req-253d8799-4678-48d7-8f24-96cb243f96a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf", "name": "network-vif-plugged", "status": "completed", "tag": "d5c544d0-346e-4b82-b925-01de0d3a61e1"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:52.494209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-6123162e-fcfc-4b30-920c-0d50f6e33559 req-253d8799-4678-48d7-8f24-96cb243f96a5 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:52.494969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-6123162e-fcfc-4b30-920c-0d50f6e33559 req-253d8799-4678-48d7-8f24-96cb243f96a5 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:52.496031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-6123162e-fcfc-4b30-920c-0d50f6e33559 req-253d8799-4678-48d7-8f24-96cb243f96a5 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:52.509346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-6123162e-fcfc-4b30-920c-0d50f6e33559 req-253d8799-4678-48d7-8f24-96cb243f96a5 service nova] Creating event network-vif-plugged:d5c544d0-346e-4b82-b925-01de0d3a61e1 for instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf on hv-cinder-85032 Aug 24 09:28:52.515257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-6123162e-fcfc-4b30-920c-0d50f6e33559 req-253d8799-4678-48d7-8f24-96cb243f96a5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106895 Aug 24 09:28:52.516059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 74/158] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:28:52.550310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:52.550959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:52.553866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:52.557194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:52.557673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:52.558105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:52.558789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:52.559240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:52.559764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:52.687224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:52.694848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ba37e913-8a7b-4641-bc57-79cfd944453e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.148370 Aug 24 09:28:52.695410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 85/159] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:52 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:52.923145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:52.923995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:52.930510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:52.930996 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:52.931442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:52.932255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:52.932720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:52.933146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:53.107611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:53.108226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:53.115828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:53.116380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:53.123877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:53.124847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:53.125469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:53.126048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:53.148081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:53.159907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:53.161909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:53.165494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3e19207b-05e4-4de6-ab05-af999c788b22 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.246686 Aug 24 09:28:53.166573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 75/160] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:53.301789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:53.302931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:53.304964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:53.309172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:53.310428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:53.310953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:53.311659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:53.312139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:53.312569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:53.315041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d448d3f5-4fe7-400b-acb4-eb7833ba5852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.210945 Aug 24 09:28:53.315041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 86/161] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:53.444665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:53.448204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:53.453251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-41d8653c-b32e-4c05-bd40-0fa68a26c03c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.156309 Aug 24 09:28:53.453812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 76/162] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:53 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:53.719020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:53.720205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:53.735529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:53.735529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:53.735529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:53.735529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:53.735981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:53.735981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:53.897824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:53.906925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-87f65485-dd56-47a0-a96e-3684dcdb92fb tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.194298 Aug 24 09:28:53.909676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 87/163] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:53 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:54.190794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:54.193060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:54.195297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:54.198859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.199384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.199918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.201408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.201890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.202311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.342635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:54.343413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:54.353174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.355381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.360945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.368813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.369699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.371366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.385135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:54.399067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:54.404477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:54.410132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-92d34743-f473-4ab1-94da-1a562d171501 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.221371 Aug 24 09:28:54.411375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 77/164] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:54.475169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:54.476096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:54.493246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.493796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.494343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.495228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.495766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.496340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.548788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:54.557705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6faa8737-dd5b-4aee-845c-ec33aaabc051 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.224902 Aug 24 09:28:54.562146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 88/165] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:54.563562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-79d36c90-15c1-469d-b221-269b7d2890f5 req-d5860335-7985-4b09-be69-4e6d8141a316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb650451-50be-4714-b442-2a6cbcf96d6d", "name": "network-vif-plugged", "status": "completed", "tag": "b99cb60a-57da-4793-a9df-1b6184d7afdb"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:28:54.572987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-79d36c90-15c1-469d-b221-269b7d2890f5 req-d5860335-7985-4b09-be69-4e6d8141a316 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.573471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-79d36c90-15c1-469d-b221-269b7d2890f5 req-d5860335-7985-4b09-be69-4e6d8141a316 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.573897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-79d36c90-15c1-469d-b221-269b7d2890f5 req-d5860335-7985-4b09-be69-4e6d8141a316 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.585285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-79d36c90-15c1-469d-b221-269b7d2890f5 req-d5860335-7985-4b09-be69-4e6d8141a316 service nova] Creating event network-vif-plugged:b99cb60a-57da-4793-a9df-1b6184d7afdb for instance eb650451-50be-4714-b442-2a6cbcf96d6d on hv-cinder-85032 Aug 24 09:28:54.590504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-79d36c90-15c1-469d-b221-269b7d2890f5 req-d5860335-7985-4b09-be69-4e6d8141a316 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031156 Aug 24 09:28:54.591119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 89/166] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:28:54.641166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:54.651775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-658db58e-841f-47e0-b5a8-44011762038e tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.180970 Aug 24 09:28:54.654696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 78/167] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:54 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:54.928764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:54.929504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:54.935607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.936095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.936528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:54.937211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:54.937700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:54.938157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:55.070048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:55.078104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0929692f-c054-45da-b2ad-d598f481c171 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.153660 Aug 24 09:28:55.078666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 90/168] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:54 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:55.433313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:55.433926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:55.442262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:55.442758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:55.443222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:55.443922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:55.444560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:55.445142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:55.579036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:55.579568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:55.587715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:55.588429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:55.589026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:55.589889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:55.590829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:55.591697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:55.595205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:55.606065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:55.608179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:55.609301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c5c8da99-e696-469d-883f-bbaf0427df4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.179823 Aug 24 09:28:55.618977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 79/169] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:55 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:55.626612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:28:55.675392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:55.675668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:55.682901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:55.684006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:55.685067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:55.685890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:55.686558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:55.687204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:55.824524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:55.836366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-036b9f7a-7183-412b-b931-ec95d66a9278 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.258295 Aug 24 09:28:55.836366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 91/170] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:55.879152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:55.890143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b62509f1-41ab-4606-acff-b13463e32455 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.219479 Aug 24 09:28:55.893418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 80/171] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:55 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:56.101024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:56.101930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:56.111718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:56.113576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:56.114776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:56.115778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:56.117669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:56.119033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:56.301341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:56.309133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-78893dbe-4153-4ee9-b136-65f83e0707e2 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.212633 Aug 24 09:28:56.328252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 92/172] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:56 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:56.633979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:56.635218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:56.641917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:56.644835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:56.644835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:56.644835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:56.644835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:56.645379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:56.859010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:56.860654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:56.882998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:56.883881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:56.884321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:56.885037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:56.885530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:56.885956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:57.267242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:57.279030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:57.280720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:57.281959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b6cb11f2-8afb-4b50-aae7-33df59380dc5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.652963 Aug 24 09:28:57.282614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 81/173] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:28:57.303539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:57.305178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:57.314316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:57.315041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:57.315723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:57.317332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:57.318907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:57.319572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:57.344507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:57.352185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-586a0a86-4faa-4baf-818c-853f6d568e1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.497356 Aug 24 09:28:57.358525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 93/174] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:57.374843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:57.375610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:57.381687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:57.382181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:57.389992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:57.389992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:57.389992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:57.389992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:57.763104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:57.772923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4afa2c11-8f87-42eb-aa6c-bc2475f8a31d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.415516 Aug 24 09:28:57.774081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 94/175] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:57 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:57.857413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:57.880773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3970b8c2-ebe3-4fd6-9239-2aa2a56f904c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.582552 Aug 24 09:28:57.889530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 82/176] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:57 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:58.308192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:58.309051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:58.327839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.327839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.327839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.328610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.329302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.329881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.381793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:58.382700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:58.391431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.392054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.392680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.393549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.394473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.395057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.584399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:58.595385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3e721785-3c74-46d9-9153-3e6e102a0977 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.220803 Aug 24 09:28:58.596487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 83/177] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:58.714712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:58.722813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:58.724335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:58.725430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c5449e0e-b672-41ab-a860-4931b3c44c86 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.422386 Aug 24 09:28:58.726504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 95/178] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:28:58.798274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:58.799040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:58.805770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.806652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.807097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.808099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.808915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.810130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.906809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:58.907422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:58.913440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.914059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.914579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.915386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:58.915864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:58.916278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:58.994371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:59.020771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c07dd600-90ff-49ee-aa11-576383e48e6e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.225883 Aug 24 09:28:59.041606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 84/179] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:58 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:59.115669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:59.123784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51a1c680-379a-4487-a692-d7e32a07c790 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.220877 Aug 24 09:28:59.126906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 96/180] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:58 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:28:59.629844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:59.630491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:59.639369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:59.640109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:59.640893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:59.642010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:59.642355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:59.643325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:59.749427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:28:59.750200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:28:59.756501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:59.757816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:59.757816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:59.758266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:28:59.758748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:28:59.759170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:28:59.780281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:59.789294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eaeb9802-68f3-44a8-86e0-7d7e7a236e45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.173031 Aug 24 09:28:59.796040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 85/181] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:28:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:28:59.900597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:59.909602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:59.911151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:28:59.912292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-77a7568e-0d07-40fc-b53b-69663dd09979 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.168048 Aug 24 09:28:59.913164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 97/182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:28:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:29:00.049046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:00.050234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:00.056928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.057575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.058159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.059031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.060207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.060784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.143710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:00.144631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:00.157584 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.159969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.159969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.159969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.160404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.160978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.216909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:00.226437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1c9a80bc-265d-4c85-b798-b4dc89abc503 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.181573 Aug 24 09:29:00.227007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 86/183] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:00 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:00.234790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-636f49dd-2079-4c4f-a4dd-649122fffd72 req-c07e0de8-f810-45f1-8e91-81c64ff96473 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e093c82-b762-45aa-840b-26b6b982f8bc", "name": "network-vif-plugged", "status": "completed", "tag": "c90b8067-74c1-43cb-b490-fe8f8d77018f"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:00.254269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-636f49dd-2079-4c4f-a4dd-649122fffd72 req-c07e0de8-f810-45f1-8e91-81c64ff96473 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.257563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-636f49dd-2079-4c4f-a4dd-649122fffd72 req-c07e0de8-f810-45f1-8e91-81c64ff96473 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.260418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-636f49dd-2079-4c4f-a4dd-649122fffd72 req-c07e0de8-f810-45f1-8e91-81c64ff96473 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.278677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-636f49dd-2079-4c4f-a4dd-649122fffd72 req-c07e0de8-f810-45f1-8e91-81c64ff96473 service nova] Creating event network-vif-plugged:c90b8067-74c1-43cb-b490-fe8f8d77018f for instance 9e093c82-b762-45aa-840b-26b6b982f8bc on hv-cinder-85032 Aug 24 09:29:00.289765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-636f49dd-2079-4c4f-a4dd-649122fffd72 req-c07e0de8-f810-45f1-8e91-81c64ff96473 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055847 Aug 24 09:29:00.290394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 87/184] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:00.361283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:00.368953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-05183801-feee-4392-9cd2-7b361c7df97d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.229358 Aug 24 09:29:00.369523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 98/185] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:00 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:00.810748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:00.811746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:00.818236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.818692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.819202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.819943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.820398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.820989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.937899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:00.937899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:00.944043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.947202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.952089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:00.954775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:00.955463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:00.956190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:01.021052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:01.032426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b54e55b1-3597-4570-bf9f-4f02d61e6b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1366 microversion: 2.1 time: 0.225725 Aug 24 09:29:01.033167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 88/186] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:01.144441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:01.155931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:01.161290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:01.161290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cfec8637-e08b-4f68-b970-d549a68db372 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.228207 Aug 24 09:29:01.161290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 99/187] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:29:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:29:01.246502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:01.247851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:01.254450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:01.255025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:01.258882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:01.258882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:01.258882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:01.258882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:01.396615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:01.397563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:01.405071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:01.405820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:01.408551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:01.409242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:01.409901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:01.410509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:01.439483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:01.450631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f67ab319-1d2f-4a9b-b12d-cdc69a57b74e tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1312 microversion: 2.1 time: 0.207593 Aug 24 09:29:01.451411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 89/188] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:01 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:01.570468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:01.596083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-85823ce2-d932-4dfe-a355-779ceb692813 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.203163 Aug 24 09:29:01.602454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 100/189] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:01 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:02.053548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:02.054326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:02.060950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.061524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.062031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.062800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.063322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.063850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.181102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:02.192855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:02.195520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.197030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.197292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.198100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.198557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.198999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.231864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:02.244451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-395e73a5-28c8-4160-87a7-1294d30abd1c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1557 microversion: 2.1 time: 0.191082 Aug 24 09:29:02.244451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 90/190] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1557 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:29:02.263297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:02.263938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:02.273139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.273139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.273139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.273139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.273659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.274250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.368603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:02.378195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:02.379866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:02.380971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-25f4b499-a2cb-45e3-b1c8-22d8c5449841 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.203619 Aug 24 09:29:02.381553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 101/191] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:29:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:29:02.386023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-a3c27eaf-8c13-4ff2-868f-0e3a2716d60b req-02a1cc0c-7668-4605-918c-464f5d4af120 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c65cee-4bde-44b8-844d-9f4a6aac5208", "name": "network-vif-plugged", "status": "completed", "tag": "b54629e7-4228-4772-903b-0ba66d767332"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:02.395194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a3c27eaf-8c13-4ff2-868f-0e3a2716d60b req-02a1cc0c-7668-4605-918c-464f5d4af120 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.401730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a3c27eaf-8c13-4ff2-868f-0e3a2716d60b req-02a1cc0c-7668-4605-918c-464f5d4af120 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.401730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-a3c27eaf-8c13-4ff2-868f-0e3a2716d60b req-02a1cc0c-7668-4605-918c-464f5d4af120 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.407480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-a3c27eaf-8c13-4ff2-868f-0e3a2716d60b req-02a1cc0c-7668-4605-918c-464f5d4af120 service nova] Creating event network-vif-plugged:b54629e7-4228-4772-903b-0ba66d767332 for instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 on hv-cinder-85032 Aug 24 09:29:02.412084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bc499fa8-0a0f-42d3-9e02-27590eecbe17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.152109 Aug 24 09:29:02.412901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-a3c27eaf-8c13-4ff2-868f-0e3a2716d60b req-02a1cc0c-7668-4605-918c-464f5d4af120 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030165 Aug 24 09:29:02.413078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 91/192] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Aug 24 09:29:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-interface => generated 285 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:02.413520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 102/193] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:02.472434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:02.473149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:02.479228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.479738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.480180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.480892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.481901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.482378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.622237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:02.623272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:02.629898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.631183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.632002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.633250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:02.633718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:02.634195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:02.769026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:02.778372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ea62f918-9149-4fc8-a278-49e784485f98 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.160548 Aug 24 09:29:02.778956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 103/194] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:02 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:29:02.788811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:02.798743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-837800c7-4a7f-4c39-bb37-c050bd1d7cd1 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1499 microversion: 2.1 time: 0.330244 Aug 24 09:29:02.799446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 92/195] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:02 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1499 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:03.403574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:03.413408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:03.420693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:03.421217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:03.421645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:03.422350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:03.423229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:03.423370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:03.596542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:03.606523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:03.608646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:03.610520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3ebf70b6-a195-4aca-b28f-185215aa5e5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1407 microversion: 2.20 time: 0.211191 Aug 24 09:29:03.621290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 104/196] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:29:03 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:29:03.814485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:03.814485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:03.820745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:03.821248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:03.821692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:03.822404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:03.824238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:03.825561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:04.052099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:04.064131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e8d49478-a55e-44c1-802d-45811decde87 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.266486 Aug 24 09:29:04.065104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-b52d55dd-6467-4e34-b1d2-4f0bc90b9cd3 req-936c5d44-a84d-43ba-95b4-fdba4ca46773 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb650451-50be-4714-b442-2a6cbcf96d6d", "tag": "b99cb60a-57da-4793-a9df-1b6184d7afdb"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:04.081094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b52d55dd-6467-4e34-b1d2-4f0bc90b9cd3 req-936c5d44-a84d-43ba-95b4-fdba4ca46773 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:04.081271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 93/197] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:03 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:04.081387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b52d55dd-6467-4e34-b1d2-4f0bc90b9cd3 req-936c5d44-a84d-43ba-95b4-fdba4ca46773 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:04.081387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b52d55dd-6467-4e34-b1d2-4f0bc90b9cd3 req-936c5d44-a84d-43ba-95b4-fdba4ca46773 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:04.089879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-b52d55dd-6467-4e34-b1d2-4f0bc90b9cd3 req-936c5d44-a84d-43ba-95b4-fdba4ca46773 service nova] Creating event network-changed:b99cb60a-57da-4793-a9df-1b6184d7afdb for instance eb650451-50be-4714-b442-2a6cbcf96d6d on hv-cinder-85032 Aug 24 09:29:04.095805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-b52d55dd-6467-4e34-b1d2-4f0bc90b9cd3 req-936c5d44-a84d-43ba-95b4-fdba4ca46773 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034236 Aug 24 09:29:04.096395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 105/198] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:29:04.634619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:04.635143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:04.641261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:04.641745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:04.642181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:04.642865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:04.643310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:04.643763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:04.663854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:04.829370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:04.839551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:04.841345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:04.842551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1b2549f0-7ded-4a9c-82f8-bca70987d92b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1600 microversion: 2.20 time: 0.211986 Aug 24 09:29:04.843134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 94/199] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:29:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:29:04.865644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:04.866241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:04.873335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:04.873821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:04.874255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:04.874952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:04.875653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:04.876043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:04.997276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f8a87498-2d9b-4ea5-a35b-dacde263861c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.135439 Aug 24 09:29:04.998137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 106/200] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Aug 24 09:29:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-interface => generated 285 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:29:05.086484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:05.087368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:05.094930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:05.095434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:05.095914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:05.096627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:05.097092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:05.097513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:05.347622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:05.356297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-28ce97e8-a29e-4bbe-84cf-4291b91419dc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.273686 Aug 24 09:29:05.366428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 95/201] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:05 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:05.861964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5a1c19af-9983-4e77-8c20-e95053ed865f"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:05.864693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:05.870860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:05.872656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:05.873179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:05.873878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:05.874325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:05.874738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:06.157294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-5668423b-23a2-4670-8fc5-cd48dd6354d1 req-ae78bf8e-eec8-4132-9173-c05531955064 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e093c82-b762-45aa-840b-26b6b982f8bc", "tag": "c90b8067-74c1-43cb-b490-fe8f8d77018f"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:06.167791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-5668423b-23a2-4670-8fc5-cd48dd6354d1 req-ae78bf8e-eec8-4132-9173-c05531955064 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:06.169356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-5668423b-23a2-4670-8fc5-cd48dd6354d1 req-ae78bf8e-eec8-4132-9173-c05531955064 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:06.169805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-5668423b-23a2-4670-8fc5-cd48dd6354d1 req-ae78bf8e-eec8-4132-9173-c05531955064 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:06.181253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-5668423b-23a2-4670-8fc5-cd48dd6354d1 req-ae78bf8e-eec8-4132-9173-c05531955064 service nova] Creating event network-changed:c90b8067-74c1-43cb-b490-fe8f8d77018f for instance 9e093c82-b762-45aa-840b-26b6b982f8bc on hv-cinder-85032 Aug 24 09:29:06.198405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-5668423b-23a2-4670-8fc5-cd48dd6354d1 req-ae78bf8e-eec8-4132-9173-c05531955064 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045362 Aug 24 09:29:06.199024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 96/202] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:06.378070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:06.378817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:06.396681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:06.397162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:06.400130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:06.401221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:06.404896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:06.405514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:06.544742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:06.554489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0b2b7ecf-43d8-49d5-850e-121a28eb7918 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.180593 Aug 24 09:29:06.555403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 97/203] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:06 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:29:07.575688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:07.576308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:07.582428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:07.582909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:07.583346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:07.584066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:07.584522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:07.584998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:07.719170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:07.726993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-52641c63-f1c5-4191-8687-ed92dc42ae3f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.155176 Aug 24 09:29:07.727559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 98/204] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:07 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:29:08.748591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:08.749197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:08.755047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:08.755524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:08.755984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:08.756670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:08.757125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:08.757541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:08.887301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:08.894737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-065b035f-692e-46c0-97f6-85d658ae8f13 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1361 microversion: 2.1 time: 0.150524 Aug 24 09:29:08.895294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 99/205] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:08 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:29:09.915314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:09.916048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:09.922622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:09.923101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:09.923539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:09.924265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:09.924716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:09.925143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:09.970624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5bb03ab5-b451-4b3c-a59b-4cccb94be614 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "POST /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.112432 Aug 24 09:29:09.971188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 107/206] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 09:29:05 2022] POST /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf/os-volume_attachments => generated 194 bytes in 4114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:10.117118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:10.131411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2961900f-00e2-415f-b07a-72cfa2bc0a8a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1546 microversion: 2.1 time: 0.217996 Aug 24 09:29:10.132848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 100/207] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:09 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1546 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:29:10.158922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:10.159665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:10.169402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:10.201616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:10.201616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:10.201616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:10.201616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:10.202023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:10.202023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:10.404123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8dffc125-a924-4384-bbbb-6cac93343b03 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.250251 Aug 24 09:29:10.404977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 108/208] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Aug 24 09:29:10 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208/os-interface => generated 284 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:11.631174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-b6def7c5-322e-4b98-b6b5-116bbe6f2fc6 req-f8d99b18-f799-4a69-8614-1f7284d0b591 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c65cee-4bde-44b8-844d-9f4a6aac5208", "tag": "b54629e7-4228-4772-903b-0ba66d767332"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:11.641647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b6def7c5-322e-4b98-b6b5-116bbe6f2fc6 req-f8d99b18-f799-4a69-8614-1f7284d0b591 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:11.642384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b6def7c5-322e-4b98-b6b5-116bbe6f2fc6 req-f8d99b18-f799-4a69-8614-1f7284d0b591 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:11.642817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b6def7c5-322e-4b98-b6b5-116bbe6f2fc6 req-f8d99b18-f799-4a69-8614-1f7284d0b591 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:11.654756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-b6def7c5-322e-4b98-b6b5-116bbe6f2fc6 req-f8d99b18-f799-4a69-8614-1f7284d0b591 service nova] Creating event network-changed:b54629e7-4228-4772-903b-0ba66d767332 for instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 on hv-cinder-85032 Aug 24 09:29:11.660011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-b6def7c5-322e-4b98-b6b5-116bbe6f2fc6 req-f8d99b18-f799-4a69-8614-1f7284d0b591 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033008 Aug 24 09:29:11.660716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 101/209] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:17.677948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1111107547", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "networks": [{"uuid": "263e0084-e2b2-4f10-a959-4efc18a3f155"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:17.735078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] validate_networks() for [('263e0084-e2b2-4f10-a959-4efc18a3f155', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:29:18.087656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:29:18.093906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:29:18.093906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:29:18.093906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:29:18.093906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:29:18.098129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:18.098601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:18.099029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:18.099851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:18.103219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:18.103746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:18.122790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Getting quotas for project 6204c9e825f841aab905eac66e6a4a1e. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:29:18.126829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Getting quotas for user b3cd284afb854b1e987e807127752925 and project 6204c9e825f841aab905eac66e6a4a1e. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:29:18.137616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:29:18.139971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:29:18.304550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c31a2eef-dc5c-420e-921d-56020fbc799d tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.631069 Aug 24 09:29:18.305496 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 109/210] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:29:18.317707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-739afffc-7e3f-4445-a1e2-d8b6a1073190 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:18.318418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-739afffc-7e3f-4445-a1e2-d8b6a1073190 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:18.376222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-739afffc-7e3f-4445-a1e2-d8b6a1073190 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:18.383372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-739afffc-7e3f-4445-a1e2-d8b6a1073190 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1214 microversion: 2.1 time: 0.070315 Aug 24 09:29:18.391934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 102/211] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:18 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:19.405813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:19.406353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:19.412585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:19.413075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:19.413491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:19.414164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:19.414610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:19.415029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:19.478088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:19.486332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-98aeef4b-3d82-4eca-b636-a3e414484342 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1218 microversion: 2.1 time: 0.084985 Aug 24 09:29:19.486933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 110/212] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:19 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:20.507465 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:20.508101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:20.514885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:20.515357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:20.515827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:20.516555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:20.516997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:20.517415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:20.580458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:20.588213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e6c25be9-095a-459c-af4c-09278e584ceb tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1266 microversion: 2.1 time: 0.084575 Aug 24 09:29:20.588777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 103/213] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:20 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:21.610143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:21.611376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:21.618848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:21.622309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:21.622309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:21.622309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:21.622309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:21.622738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:21.695606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:21.705696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f93332bf-bd45-4eee-9d5c-098b14f4be35 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1272 microversion: 2.1 time: 0.100432 Aug 24 09:29:21.708445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 111/214] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:21 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:22.728458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:22.730829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:22.737680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:22.740099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:22.740099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:22.740099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:22.740492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:22.741233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:23.120180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:23.129492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-75a089e0-7e0f-438d-872e-dd9bb5203b25 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.407037 Aug 24 09:29:23.130217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 104/215] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:22 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:23.666825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-556e9785-8626-4c4b-85a0-2bbca4bbc9de req-070c1deb-81dd-4422-915b-c817c7b5640d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d645ce-65c1-4f16-a7e3-4103cfa75735", "tag": "3b9f2439-4a7b-42d9-83b1-dd0dbd306e20"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:23.674426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:23.682252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-556e9785-8626-4c4b-85a0-2bbca4bbc9de req-070c1deb-81dd-4422-915b-c817c7b5640d service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:23.682979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-556e9785-8626-4c4b-85a0-2bbca4bbc9de req-070c1deb-81dd-4422-915b-c817c7b5640d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:23.684202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-556e9785-8626-4c4b-85a0-2bbca4bbc9de req-070c1deb-81dd-4422-915b-c817c7b5640d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:23.701551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-556e9785-8626-4c4b-85a0-2bbca4bbc9de req-070c1deb-81dd-4422-915b-c817c7b5640d service nova] Creating event network-changed:3b9f2439-4a7b-42d9-83b1-dd0dbd306e20 for instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 on hv-cinder-85032 Aug 24 09:29:23.708864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-556e9785-8626-4c4b-85a0-2bbca4bbc9de req-070c1deb-81dd-4422-915b-c817c7b5640d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045242 Aug 24 09:29:23.710056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 112/216] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:24.150608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:24.151220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:24.157162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:24.157641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:24.158078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:24.158761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:24.159213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:24.159662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:24.432999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:24.441106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5c024014-5417-4b81-800d-a10a0e5ecdfd tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.294247 Aug 24 09:29:24.441587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 105/217] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:24 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:25.462441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:25.463141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:25.470109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:25.470573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:25.478655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:25.478655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:25.478655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:25.478655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:25.626636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:25.634237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6db119d9-d7c0-4d46-9dc8-ed206ab11256 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.177366 Aug 24 09:29:25.634799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 113/218] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:25 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:26.655259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:26.655969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:26.657918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=59 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:26.662758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:26.663330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:26.663892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:26.668092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:26.668092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:26.668092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:26.993278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:27.001895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5c9060d0-a365-4e30-a25c-e9c1ef9110d1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.351505 Aug 24 09:29:27.002468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 106/219] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:26 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:28.023207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:28.023849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:28.030590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:28.031102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:28.031536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:28.032256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:28.032708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:28.033133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:28.111685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:28.133719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:28.165305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:28.172835 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51ff40b0-fd71-4993-8868-3c490b87e99e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.153482 Aug 24 09:29:28.173398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 114/220] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:28 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:29.195395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:29.196065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:29.198088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:29.204677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:29.205167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:29.205606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:29.206311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:29.206769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:29.207203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:29.347812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:29.355993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-26e5c1e0-c901-4cd1-8b82-d11b6e468945 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.165011 Aug 24 09:29:29.356647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 107/221] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:29 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:30.378140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:30.378930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:30.387103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:30.387835 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:30.388473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:30.389356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:30.390076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:30.390703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:30.526166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:30.526763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:30.533093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:30.533846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:30.534490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:30.535388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:30.536053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:30.536678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:30.568711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:29:30.568865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:30.576735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-29acc3dd-c217-4a22-9b19-829e93a045a0 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.203970 Aug 24 09:29:30.577418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 115/222] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:30 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:30.810572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7522f141-d5c7-4fdc-82cd-f82498954823 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 204 len: 0 microversion: 2.1 time: 0.288336 Aug 24 09:29:30.811146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 108/223] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:29:30 2022] DELETE /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 09:29:30.819404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:30.820042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:30.825880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:30.826353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:30.826782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:30.827465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:30.827938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:30.828356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:30.959787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:30.968812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eb096c01-0e53-4123-92e3-d69c89ca6661 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1551 microversion: 2.1 time: 0.153280 Aug 24 09:29:30.969481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 116/224] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:30 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1551 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:31.598591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:31.599280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:31.605369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:31.611392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:31.611392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:31.611392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:31.611392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:31.611901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:31.784565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:31.792108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c55f11d3-79df-415c-aa4d-c8fd1cf99a51 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.197780 Aug 24 09:29:31.792675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 109/225] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:31 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:31.991703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:31.992418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:31.998945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:31.999500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:32.000259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:32.000900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:32.001367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:32.001792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:32.135650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:32.144296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-53bf17c1-c397-40d8-a3a7-eee6b580aa35 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1551 microversion: 2.1 time: 0.157851 Aug 24 09:29:32.145129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 117/226] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:31 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1551 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:32.813611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:32.814479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:32.820641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:32.821190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:32.821688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:32.822436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:32.822884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:32.823350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:32.959443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:32.968000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f9ae294f-c563-4f64-bb78-805469b1f07b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.158420 Aug 24 09:29:32.968568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 110/227] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:32 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:33.166485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:33.167014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:33.173818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:33.174312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:33.174755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:33.175486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:33.175971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:33.176399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:33.323099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:33.333713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8b6f050f-eeee-4ec7-877a-f26102ca6a2f tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1551 microversion: 2.1 time: 0.171025 Aug 24 09:29:33.334598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 118/228] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:33 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1551 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:33.987966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:33.993876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:33.994539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:33.995025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:33.995557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:33.996285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:33.996742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:33.997163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:34.133047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:34.137061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:34.142267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-10f41952-e723-4117-bb52-ebd0e18ccd38 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.158188 Aug 24 09:29:34.148020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 111/229] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:33 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:34.355963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:34.364861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:34.364861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:34.364861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:34.364861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:34.365354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:34.365354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:34.365741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:34.513772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:34.519629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-42bd6aeb-d125-4f76-8ea9-c9d1bdd5eb77 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1551 microversion: 2.1 time: 0.168166 Aug 24 09:29:34.520197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 119/230] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:34 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1551 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:35.165388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:35.165986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:35.173510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:35.173989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:35.174590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:35.175284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:35.175919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:35.176336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:35.322560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:35.331571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-36dfe736-e265-4019-849c-0d61acf24697 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.171024 Aug 24 09:29:35.332170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 112/231] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:35 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:35.542582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:35.543701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:35.549875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:35.550359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:35.550790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:35.551473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:35.551949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:35.552366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:35.679424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:35.688007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e84e1d65-b002-46ae-b663-dd2bda8ab736 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1551 microversion: 2.1 time: 0.149703 Aug 24 09:29:35.688560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 120/232] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:35 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1551 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:36.352782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:36.353442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:36.364665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:36.364665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:36.364665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:36.364665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:36.365024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:36.365024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:36.510760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:36.518793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-909187a0-bc1e-42d1-9fc4-89647122f48a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.169993 Aug 24 09:29:36.519655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 113/233] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:36 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:36.709117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:36.709834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:36.717646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:36.718280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:36.719041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:36.719968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:36.720812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:36.721359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:36.864021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:36.874678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ae198e95-824c-462f-adf3-664c96381e50 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1551 microversion: 2.1 time: 0.167969 Aug 24 09:29:36.874678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 121/234] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:36 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1551 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:36.990272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-eace1d5c-2302-442e-a22f-b130dae1cc69 req-2c9694ed-9c03-4161-b837-9beaaaebe860 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d645ce-65c1-4f16-a7e3-4103cfa75735", "name": "network-vif-plugged", "status": "completed", "tag": "3b9f2439-4a7b-42d9-83b1-dd0dbd306e20"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:37.000915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-eace1d5c-2302-442e-a22f-b130dae1cc69 req-2c9694ed-9c03-4161-b837-9beaaaebe860 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:37.001397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-eace1d5c-2302-442e-a22f-b130dae1cc69 req-2c9694ed-9c03-4161-b837-9beaaaebe860 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:37.002132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-eace1d5c-2302-442e-a22f-b130dae1cc69 req-2c9694ed-9c03-4161-b837-9beaaaebe860 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:37.015686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-eace1d5c-2302-442e-a22f-b130dae1cc69 req-2c9694ed-9c03-4161-b837-9beaaaebe860 service nova] Creating event network-vif-plugged:3b9f2439-4a7b-42d9-83b1-dd0dbd306e20 for instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 on hv-cinder-85032 Aug 24 09:29:37.022949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-eace1d5c-2302-442e-a22f-b130dae1cc69 req-2c9694ed-9c03-4161-b837-9beaaaebe860 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035358 Aug 24 09:29:37.023543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 114/235] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:37.550615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:37.550615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:37.550615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:37.550615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:37.551364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:37.551364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:37.551364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:37.551364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:37.716323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:37.725788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9ef68ec4-d57b-4e78-9eb2-05ee2764bbfa tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.190794 Aug 24 09:29:37.726463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 122/236] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:37 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:37.894615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:37.895425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:37.901659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:37.902360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:37.902901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:37.903724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:37.904176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:37.904598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:38.162745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-90689c24-0e18-4394-881e-89a63b3a8b7e req-80e25bb5-3fa4-43f2-a30f-149e5a4d90e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf", "name": "network-vif-deleted", "tag": "d5c544d0-346e-4b82-b925-01de0d3a61e1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:38.174212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-90689c24-0e18-4394-881e-89a63b3a8b7e req-80e25bb5-3fa4-43f2-a30f-149e5a4d90e7 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:38.175226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-90689c24-0e18-4394-881e-89a63b3a8b7e req-80e25bb5-3fa4-43f2-a30f-149e5a4d90e7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:38.175829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-90689c24-0e18-4394-881e-89a63b3a8b7e req-80e25bb5-3fa4-43f2-a30f-149e5a4d90e7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:38.188721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-90689c24-0e18-4394-881e-89a63b3a8b7e req-80e25bb5-3fa4-43f2-a30f-149e5a4d90e7 service nova] Creating event network-vif-deleted:d5c544d0-346e-4b82-b925-01de0d3a61e1 for instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf on hv-cinder-85032 Aug 24 09:29:38.191473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:38.195074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-90689c24-0e18-4394-881e-89a63b3a8b7e req-80e25bb5-3fa4-43f2-a30f-149e5a4d90e7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Aug 24 09:29:38.195719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 123/237] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:29:38.202437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-134d1c32-040f-4403-b3ca-87c37c790dc3 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1551 microversion: 2.1 time: 0.311970 Aug 24 09:29:38.207129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 115/238] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:37 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1551 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:38.746990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:38.747716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:38.754302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:38.754780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:38.755211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:38.755929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:38.756386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:38.759870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:38.906641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:38.918644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cae8a98b-db73-494b-a03a-8fc24fdbfa3b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.172447 Aug 24 09:29:38.919256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 124/239] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:38 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:39.223958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:39.224639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:39.230797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:39.233908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:39.233908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:39.233908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:39.233908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:39.234222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:39.317174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:39.325621 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-72a345f9-7c22-4d2d-a443-a287959671b9 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1343 microversion: 2.1 time: 0.105395 Aug 24 09:29:39.326299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 116/240] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:39 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1343 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:39.938865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:39.939498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:39.946666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:39.947173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:39.947687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:39.948427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:39.949488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:39.949957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:40.086028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:40.094040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e2be6078-022b-4270-a0ca-ee53a6ed6cf3 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1314 microversion: 2.1 time: 0.159059 Aug 24 09:29:40.094614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 125/241] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:39 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:40.351551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:40.352274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:40.358688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:40.359246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:40.359827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:40.360724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:40.373599 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:40.373599 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:40.394310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:40.394789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:40.395299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:40.395796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lazy-loading 'fault' on Instance uuid 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:29:40.439674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cad69b6035948fe91e9beb66c807d28', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe8949d7fc8b4ca89fd81421d7e94122', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:40.448354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-10dd6acb-906a-497d-8d97-f02542760874 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 200 len: 1348 microversion: 2.1 time: 0.100860 Aug 24 09:29:40.448929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 117/242] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:40 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:41.115114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:41.115895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:41.122298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:41.122778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:41.123209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:41.123932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:41.124385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:41.124806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:41.254098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:41.262274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-50e4c61f-0574-46ac-8386-f8e54b70521e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1498 microversion: 2.1 time: 0.150546 Aug 24 09:29:41.262760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 126/243] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:41 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:41.469698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:41.470319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:41.476518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:41.476998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:41.477441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:41.478133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:41.478585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:41.479016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:41.494346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] HTTP exception thrown: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Request method failure captured: Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf HTTP/1.1 Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8kFyYb21LdkT_PrBcb4M1NtkvOSRvJRtYoBdqbyiahyicG5xz6lDDG3uk_Cusc8q03utw7PSfO7u5nUHGfxlKxTfHApOwKSu-DW6Jq-GGvdOEw3boS-uXWe7tCNJbZ79oYU4UV4bK-rLH4HZUOIqKPEUEIvR22mGzsErj2bzASehM Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:29:41.504824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe8949d7fc8b4ca89fd81421d7e94122", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 6cad69b6035948fe91e9beb66c807d28 Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.506252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf'} Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:29:41.507065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.508443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.509636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Returning 404 to user: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:29:41.509636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-adff6f05-eb63-45aa-b355-64ff827610fa tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 404 len: 111 microversion: 2.1 time: 0.040476 Aug 24 09:29:41.509636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 118/244] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:41 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:29:41.618493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:41.620642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:41.627025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:41.627515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:41.627979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:41.628673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:41.629162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:41.629588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:41.633294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:41.642301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] HTTP exception thrown: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Request method failure captured: Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf/os-volume_attachments HTTP/1.1 Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8kFyYb21LdkT_PrBcb4M1NtkvOSRvJRtYoBdqbyiahyicG5xz6lDDG3uk_Cusc8q03utw7PSfO7u5nUHGfxlKxTfHApOwKSu-DW6Jq-GGvdOEw3boS-uXWe7tCNJbZ79oYU4UV4bK-rLH4HZUOIqKPEUEIvR22mGzsErj2bzASehM Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:29:41.646391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe8949d7fc8b4ca89fd81421d7e94122", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: 6cad69b6035948fe91e9beb66c807d28 Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.652998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'server_id': '00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf'} Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:29:41.653808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:41.655101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:41.656444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Returning 404 to user: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:29:41.656444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c32470fe-c56e-4fc4-a7b1-d3414d94f14d tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.033265 Aug 24 09:29:41.656444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 127/245] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:29:41 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:29:42.491346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:42.491945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:42.498140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:42.498638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:42.499077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:42.499824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:42.500277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:42.500702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:42.525936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:29:42.832647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4ab783d1-03d0-44d1-8639-2d2d9107db84 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "DELETE /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 204 len: 0 microversion: 2.1 time: 0.345189 Aug 24 09:29:42.833333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 119/246] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:29:42 2022] DELETE /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:29:42.843013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:42.843760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:42.850350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:42.850826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:42.851375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:42.852291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:42.852780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:42.853271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:42.989640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:42.996172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:43.000370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:43.006578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:43.007065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:43.007496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:43.007628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-491ab92e-4568-4dd9-85f3-ead76ff3efd5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1504 microversion: 2.1 time: 0.169390 Aug 24 09:29:43.008102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 128/247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:42 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:43.008356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:43.008811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:43.009229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:43.023557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] HTTP exception thrown: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Request method failure captured: Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: DELETE /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf HTTP/1.1 Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8kFyYb21LdkT_PrBcb4M1NtkvOSRvJRtYoBdqbyiahyicG5xz6lDDG3uk_Cusc8q03utw7PSfO7u5nUHGfxlKxTfHApOwKSu-DW6Jq-GGvdOEw3boS-uXWe7tCNJbZ79oYU4UV4bK-rLH4HZUOIqKPEUEIvR22mGzsErj2bzASehM Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:29:43.025626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe8949d7fc8b4ca89fd81421d7e94122", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 6cad69b6035948fe91e9beb66c807d28 Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.027098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf'} Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:29:43.027959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.029257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.030713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Returning 404 to user: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:29:43.030713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0e1b27b9-1e67-421d-bbd4-2cfb90013420 tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "DELETE /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 404 len: 111 microversion: 2.1 time: 0.041582 Aug 24 09:29:43.030713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 120/248] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:29:42 2022] DELETE /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:29:43.035835 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:43.040594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] [instance: 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:43.042567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:43.043049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:43.043507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:43.044223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:43.044700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:43.045125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:43.058549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] HTTP exception thrown: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Request method failure captured: Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf HTTP/1.1 Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8kFyYb21LdkT_PrBcb4M1NtkvOSRvJRtYoBdqbyiahyicG5xz6lDDG3uk_Cusc8q03utw7PSfO7u5nUHGfxlKxTfHApOwKSu-DW6Jq-GGvdOEw3boS-uXWe7tCNJbZ79oYU4UV4bK-rLH4HZUOIqKPEUEIvR22mGzsErj2bzASehM Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:29:43.061195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/fe8949d7fc8b4ca89fd81421d7e94122"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_fe8949d7fc8b4ca89fd81421d7e94122", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: fe8949d7fc8b4ca89fd81421d7e94122 Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-DeleteServersTestJSON-1161358878 Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: 6cad69b6035948fe91e9beb66c807d28 Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-DeleteServersTestJSON-1161358878-project Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.062616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf'} Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:29:43.063361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. Aug 24 09:29:43.070766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:29:43.072091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] Returning 404 to user: Instance 00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:29:43.072091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-59e5fe35-efef-4aba-b06e-0177b6c183ed tempest-DeleteServersTestJSON-1161358878 tempest-DeleteServersTestJSON-1161358878-project] 10.222.0.16 "GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf" status: 404 len: 111 microversion: 2.1 time: 0.030761 Aug 24 09:29:43.072091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 129/249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:43 2022] GET /compute/v2.1/servers/00f00b76-36ae-4b79-9e3c-a8a3e8d7c6cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:29:44.030251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:44.030975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:44.037564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:44.038123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:44.038820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:44.039733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:44.040186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:44.040604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:44.187149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:44.204416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-29571aa7-52ab-407c-aa7c-5f1df9273905 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1504 microversion: 2.1 time: 0.179125 Aug 24 09:29:44.204990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 121/250] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:44 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:45.229022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:45.230311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:45.240042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:45.240794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:45.242677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:45.245394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:45.246037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:45.247438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:45.506157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:45.514735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e81dfcf1-36df-4085-82f7-97a62e7a4efe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1504 microversion: 2.1 time: 0.292188 Aug 24 09:29:45.515309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 130/251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:45 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:45.642591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-d2c057ac-1645-4e8c-a6b4-7ee84297b476 req-11e48339-d627-476a-8e0b-5ff3c6506c60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d645ce-65c1-4f16-a7e3-4103cfa75735", "name": "network-vif-deleted", "tag": "3b9f2439-4a7b-42d9-83b1-dd0dbd306e20"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:45.652695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d2c057ac-1645-4e8c-a6b4-7ee84297b476 req-11e48339-d627-476a-8e0b-5ff3c6506c60 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:45.653166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d2c057ac-1645-4e8c-a6b4-7ee84297b476 req-11e48339-d627-476a-8e0b-5ff3c6506c60 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:45.653592 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d2c057ac-1645-4e8c-a6b4-7ee84297b476 req-11e48339-d627-476a-8e0b-5ff3c6506c60 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:45.665041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-d2c057ac-1645-4e8c-a6b4-7ee84297b476 req-11e48339-d627-476a-8e0b-5ff3c6506c60 service nova] Creating event network-vif-deleted:3b9f2439-4a7b-42d9-83b1-dd0dbd306e20 for instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 on hv-cinder-85032 Aug 24 09:29:45.670587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-d2c057ac-1645-4e8c-a6b4-7ee84297b476 req-11e48339-d627-476a-8e0b-5ff3c6506c60 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031600 Aug 24 09:29:45.674656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 122/252] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:46.537311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:46.539751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:46.544520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:46.545009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:46.545452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:46.546147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:46.546798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:46.547223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:46.597176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:46.597508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:46.598133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:46.598609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lazy-loading 'fault' on Instance uuid 99d645ce-65c1-4f16-a7e3-4103cfa75735 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:29:46.653413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:46.660297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-13a86f43-16e6-4647-917b-f97f8fba2b37 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 200 len: 1304 microversion: 2.1 time: 0.127598 Aug 24 09:29:46.660875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 131/253] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:46 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:47.682088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:47.682800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 99d645ce-65c1-4f16-a7e3-4103cfa75735] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:47.690424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:47.691100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:47.691808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:47.692609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:47.693288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:47.693723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:47.707739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] HTTP exception thrown: Instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 could not be found. Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Request method failure captured: Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 HTTP/1.1 Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe9opo1_8KQW1Hlnm-HDwRlr8hB-HY_V_S-PKnzqn1F_Zeaen3_rpWKR8jNXYktuL_rLLx940VNA1No7R8_BvVn4fZWBRnERgrYZer8Lw-J11qoN-qrY7KarI8vaMd0-F_yofX-thgDQf2GXGeuC3Yoj977VhEdzNZT4Nrz_-g_0dVg Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 6204c9e825f841aab905eac66e6a4a1e Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-VolumesActionsTest-1111059467 Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:29:47.709424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6204c9e825f841aab905eac66e6a4a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6204c9e825f841aab905eac66e6a4a1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6204c9e825f841aab905eac66e6a4a1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6204c9e825f841aab905eac66e6a4a1e", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-VolumesActionsTest-1111059467 Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 6204c9e825f841aab905eac66e6a4a1e Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-VolumesActionsTest-1111059467 Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-VolumesActionsTest-1111059467-project Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: b3cd284afb854b1e987e807127752925 Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-VolumesActionsTest-1111059467-project Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 could not be found. Aug 24 09:29:47.710904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '99d645ce-65c1-4f16-a7e3-4103cfa75735'} Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 could not be found. Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:29:47.712096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 could not be found. Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 could not be found. Aug 24 09:29:47.713456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:29:47.714491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Returning 404 to user: Instance 99d645ce-65c1-4f16-a7e3-4103cfa75735 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:29:47.714491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fb2e5609-b13d-42fa-a138-22852b741864 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735" status: 404 len: 111 microversion: 2.1 time: 0.033339 Aug 24 09:29:47.714676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 123/254] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:47 2022] GET /compute/v2.1/servers/99d645ce-65c1-4f16-a7e3-4103cfa75735 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:29:47.841152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1842748440", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "networks": [{"uuid": "263e0084-e2b2-4f10-a959-4efc18a3f155"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:48.062010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] validate_networks() for [('263e0084-e2b2-4f10-a959-4efc18a3f155', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:29:48.445569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:29:48.445994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:29:48.446466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:29:48.446961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:29:48.447544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:29:48.456824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:48.457235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:48.457661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:48.458404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:48.458851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:48.459275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:48.475961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Getting quotas for project 6204c9e825f841aab905eac66e6a4a1e. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:29:48.479951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Getting quotas for user b3cd284afb854b1e987e807127752925 and project 6204c9e825f841aab905eac66e6a4a1e. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:29:48.491239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:29:48.493613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:29:48.600296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c4c3a4de-f9a1-4762-a14f-126e5ef790fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.765944 Aug 24 09:29:48.601224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 132/255] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:29:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:29:48.612125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-46e66215-94c0-4ba0-895a-1b1ff43674fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:48.612808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-46e66215-94c0-4ba0-895a-1b1ff43674fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:48.673858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-46e66215-94c0-4ba0-895a-1b1ff43674fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:48.684652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-46e66215-94c0-4ba0-895a-1b1ff43674fe tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1214 microversion: 2.1 time: 0.075131 Aug 24 09:29:48.686299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 124/256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:48 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1214 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:49.710255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:49.710945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:49.717280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:49.727571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:49.727571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:49.727571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:49.727571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:49.727965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:49.783879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:49.792539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b0fe213d-5349-4489-889c-4e74baec06db tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1218 microversion: 2.1 time: 0.086608 Aug 24 09:29:49.793135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 133/257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:49 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:50.813028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:50.813642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:50.822784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:50.829204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:50.829690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:50.830421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:50.830882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:50.831360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:50.934165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:50.947435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9f007d5d-3355-4dcd-8367-b586a7a62da1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1274 microversion: 2.1 time: 0.138285 Aug 24 09:29:50.960646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 125/258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:50 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1274 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:51.974650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:51.975272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:51.982798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:51.991081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:51.991081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:51.991081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:51.991081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:51.991727 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:52.313626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:52.327029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-95e38715-3253-4001-906c-8eb21485bc13 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.355724 Aug 24 09:29:52.328669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 134/259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:51 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:53.107875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-70fd3533-b16d-4026-83a2-2ce38cdab0c7 req-2fd69424-8c8e-47e7-955a-6f7c6ae5264e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "037c531a-e3a8-417e-91fc-edcd0465a15b", "tag": "18c85969-a94c-46f4-aefc-3c7a3129d791"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:53.119251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-70fd3533-b16d-4026-83a2-2ce38cdab0c7 req-2fd69424-8c8e-47e7-955a-6f7c6ae5264e service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:53.120999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-70fd3533-b16d-4026-83a2-2ce38cdab0c7 req-2fd69424-8c8e-47e7-955a-6f7c6ae5264e service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:53.122373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-70fd3533-b16d-4026-83a2-2ce38cdab0c7 req-2fd69424-8c8e-47e7-955a-6f7c6ae5264e service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:53.160714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-70fd3533-b16d-4026-83a2-2ce38cdab0c7 req-2fd69424-8c8e-47e7-955a-6f7c6ae5264e service nova] Creating event network-changed:18c85969-a94c-46f4-aefc-3c7a3129d791 for instance 037c531a-e3a8-417e-91fc-edcd0465a15b on hv-cinder-85032 Aug 24 09:29:53.170005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-70fd3533-b16d-4026-83a2-2ce38cdab0c7 req-2fd69424-8c8e-47e7-955a-6f7c6ae5264e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066820 Aug 24 09:29:53.171189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 126/260] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:29:53.352415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:53.353545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:53.382774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:53.383887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:53.384693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:53.386412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:53.387770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:53.391833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:53.870485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:53.886000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9c1627ed-34c1-456f-9296-c15dddad266b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.540062 Aug 24 09:29:53.905149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 135/261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:53 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:54.910928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:54.911797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:54.918223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:54.918776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:54.919267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:54.920005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:54.924203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:54.924203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:55.104873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:55.113255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-46c1c0f7-3d5b-484e-b27e-382484732424 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.206369 Aug 24 09:29:55.128352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 127/262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:54 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:56.139522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:56.140221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:56.157617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:56.157617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:56.157617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:56.157617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:56.158019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:56.158019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:56.224984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2040065338", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:56.234258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:56.284844 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] validate_networks() for [('0a761d3a-9d39-4f90-b3ef-cc43d1b998c8', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:29:56.327985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:56.337552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3c259c42-7785-4559-8e72-48b3b0eb5e09 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.203116 Aug 24 09:29:56.340004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 128/263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:56 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:56.682010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:29:56.682696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:29:56.683615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:29:56.683918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:29:56.684712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:29:56.703917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:56.703917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:56.703917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:56.703917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:56.704222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:56.704222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:56.720342 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for project 7a0a723d97d24385875a287252f57f02. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:29:56.724223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for user 0aff36cf71984238b8a9b998043ec7be and project 7a0a723d97d24385875a287252f57f02. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:29:56.737193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:29:56.739428 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:29:56.885863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dd133698-f0c5-4cc2-b00e-2190bb9e0881 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.843783 Aug 24 09:29:56.887228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 136/264] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:29:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:29:56.897948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a5a5d7fc-0268-48a2-8fb3-a9c8d1bac288 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:56.898554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a5a5d7fc-0268-48a2-8fb3-a9c8d1bac288 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:56.900520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:29:56.952628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a5a5d7fc-0268-48a2-8fb3-a9c8d1bac288 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:56.959511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a5a5d7fc-0268-48a2-8fb3-a9c8d1bac288 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1222 microversion: 2.1 time: 0.065371 Aug 24 09:29:56.960162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 129/265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:56 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1222 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:57.108993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-618675243", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:29:57.160069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] validate_networks() for [('0a761d3a-9d39-4f90-b3ef-cc43d1b998c8', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:29:57.359823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:57.361710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:57.372127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:57.373198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:57.379708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:57.379708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:57.379708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:57.379708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:57.620756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:57.623902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:29:57.623902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:29:57.623902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:29:57.623902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:29:57.623902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:29:57.631480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c8706a39-e81c-4606-a24f-689ed1ea4bc7 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.276762 Aug 24 09:29:57.632313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 130/266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:57 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:57.643856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:57.643856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:57.643856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:57.643856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:57.644216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:57.644216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:57.665212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for project 7a0a723d97d24385875a287252f57f02. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:29:57.671339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for user 0aff36cf71984238b8a9b998043ec7be and project 7a0a723d97d24385875a287252f57f02. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:29:57.683504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:29:57.685820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:29:57.817827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3990f5a0-2061-4f53-b701-4bfd0551d8b5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.717017 Aug 24 09:29:57.820104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 137/267] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:29:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:29:57.841308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d2b774cf-6bd5-4267-8e28-987e6f9f1cfb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:57.841959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d2b774cf-6bd5-4267-8e28-987e6f9f1cfb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:57.895803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d2b774cf-6bd5-4267-8e28-987e6f9f1cfb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:57.903363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d2b774cf-6bd5-4267-8e28-987e6f9f1cfb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1221 microversion: 2.1 time: 0.073772 Aug 24 09:29:57.904239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 131/268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:57 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1221 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:58.655089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:58.655878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:58.663389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:58.664125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:58.664631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:58.665345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:58.666297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:58.666297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:58.851368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:58.860261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a20a10b2-5276-4ffd-9524-5e81c1638279 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.209872 Aug 24 09:29:58.861349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 138/269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:58 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:58.925161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:58.925785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:58.932388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:58.933074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:58.934053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:58.934757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:58.935213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:58.935668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:59.016161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:29:59.029035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-aabea85f-8ff1-4b62-92ca-d53e333e0f75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1225 microversion: 2.1 time: 0.108485 Aug 24 09:29:59.043950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 132/270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:58 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1225 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:29:59.886138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:29:59.887267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:29:59.909348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:59.909851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:59.910288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:29:59.911003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:29:59.911922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:29:59.912353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:00.049377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:00.049900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:00.056095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:00.057412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:00.057412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:00.057872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:00.058369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:00.058978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:00.073557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:00.080850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:00.092455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-80dda031-7aef-4525-a273-c3669b0abd0e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.207577 Aug 24 09:30:00.092455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 139/271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:29:59 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:00.156524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:00.164177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-53500215-d8ed-4f91-95ca-e682b31948eb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1273 microversion: 2.1 time: 0.118837 Aug 24 09:30:00.164741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 133/272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:00 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1273 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:01.107319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:01.108088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:01.115377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:01.115887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:01.116325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:01.117163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:01.117621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:01.118049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:01.184083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:01.186971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:01.194158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:01.194647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:01.195125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:01.195857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:01.196315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:01.196732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:01.259241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:01.268402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b12b43bd-0429-4440-ba04-edc8e9cbe07a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.165028 Aug 24 09:30:01.269074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 140/273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:01 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:01.284270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:01.306910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-db4b4a58-9664-4438-99b5-20856a95786e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1279 microversion: 2.1 time: 0.126528 Aug 24 09:30:01.307773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 134/274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:01 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:01.579856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-d616d776-d340-4ab9-9383-2f60b033bd69 req-10cd631d-eca5-4876-b4bf-aba792568ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037c531a-e3a8-417e-91fc-edcd0465a15b", "name": "network-vif-plugged", "status": "completed", "tag": "18c85969-a94c-46f4-aefc-3c7a3129d791"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:01.599954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d616d776-d340-4ab9-9383-2f60b033bd69 req-10cd631d-eca5-4876-b4bf-aba792568ea7 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:01.600735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d616d776-d340-4ab9-9383-2f60b033bd69 req-10cd631d-eca5-4876-b4bf-aba792568ea7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:01.603453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d616d776-d340-4ab9-9383-2f60b033bd69 req-10cd631d-eca5-4876-b4bf-aba792568ea7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:01.616563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-d616d776-d340-4ab9-9383-2f60b033bd69 req-10cd631d-eca5-4876-b4bf-aba792568ea7 service nova] Creating event network-vif-plugged:18c85969-a94c-46f4-aefc-3c7a3129d791 for instance 037c531a-e3a8-417e-91fc-edcd0465a15b on hv-cinder-85032 Aug 24 09:30:01.628814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-d616d776-d340-4ab9-9383-2f60b033bd69 req-10cd631d-eca5-4876-b4bf-aba792568ea7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054873 Aug 24 09:30:01.629565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 141/275] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:30:02.289800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:02.290417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:02.296457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:02.296980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:02.297422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:02.298961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:02.299976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:02.300624 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:02.334222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:02.335518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:02.356955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:02.357849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:02.358458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:02.359342 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:02.359982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:02.360569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:02.586957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:02.597304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e967219e-9b72-4a89-aa2e-f033c53c0a88 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.267590 Aug 24 09:30:02.607551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 142/276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:02 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:02.624804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:02.632468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-231e9f20-26c0-4515-a1de-a2d544246666 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.346556 Aug 24 09:30:02.633078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 135/277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:02 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:02.713357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-9fe9505d-7e8a-4c9f-878d-5effbfff3967 req-a9851082-5efe-497d-8b8e-6abd7262032d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5343e07-144f-42bb-b966-2db846f99964", "tag": "3ebb5115-328b-42f9-b5fc-c02856ef0d4c"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:02.722797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9fe9505d-7e8a-4c9f-878d-5effbfff3967 req-a9851082-5efe-497d-8b8e-6abd7262032d service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:02.723247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9fe9505d-7e8a-4c9f-878d-5effbfff3967 req-a9851082-5efe-497d-8b8e-6abd7262032d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:02.723711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9fe9505d-7e8a-4c9f-878d-5effbfff3967 req-a9851082-5efe-497d-8b8e-6abd7262032d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:02.735724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-9fe9505d-7e8a-4c9f-878d-5effbfff3967 req-a9851082-5efe-497d-8b8e-6abd7262032d service nova] Creating event network-changed:3ebb5115-328b-42f9-b5fc-c02856ef0d4c for instance a5343e07-144f-42bb-b966-2db846f99964 on hv-cinder-85032 Aug 24 09:30:02.740498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-9fe9505d-7e8a-4c9f-878d-5effbfff3967 req-a9851082-5efe-497d-8b8e-6abd7262032d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031668 Aug 24 09:30:02.741270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 143/278] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:30:02.930796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-d411ea56-1471-4aa4-901e-9134b2b1b42b req-c8d8d344-6017-4158-819f-322a989fe2b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10a2f38e-6e14-434b-a628-cacaecbb1492", "tag": "391ff95c-c037-4aa0-89d4-3d2d917b9473"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:02.941193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d411ea56-1471-4aa4-901e-9134b2b1b42b req-c8d8d344-6017-4158-819f-322a989fe2b0 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:02.941675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d411ea56-1471-4aa4-901e-9134b2b1b42b req-c8d8d344-6017-4158-819f-322a989fe2b0 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:02.942102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d411ea56-1471-4aa4-901e-9134b2b1b42b req-c8d8d344-6017-4158-819f-322a989fe2b0 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:02.954072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-d411ea56-1471-4aa4-901e-9134b2b1b42b req-c8d8d344-6017-4158-819f-322a989fe2b0 service nova] Creating event network-changed:391ff95c-c037-4aa0-89d4-3d2d917b9473 for instance 10a2f38e-6e14-434b-a628-cacaecbb1492 on hv-cinder-85032 Aug 24 09:30:02.959332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-d411ea56-1471-4aa4-901e-9134b2b1b42b req-c8d8d344-6017-4158-819f-322a989fe2b0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032112 Aug 24 09:30:02.959975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 136/279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:30:03.618966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:03.619694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:03.626554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:03.627159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:03.627620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:03.628328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:03.628785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:03.629235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:03.666710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:03.668037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:03.674194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:03.674675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:03.675116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:03.675840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:03.676304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:03.676725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:03.760754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:03.768685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8913547f-802b-4237-9c11-0a185d69498b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.154413 Aug 24 09:30:03.769269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 144/280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:03 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:03.805638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:03.814026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ba1f6ed2-ad25-43af-b653-fc164d9f0261 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.151432 Aug 24 09:30:03.814590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 137/281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:03 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:04.789404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:04.790016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:04.796928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:04.797412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:04.797852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:04.798578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:04.799056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:04.799485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:04.834492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:04.835109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:04.842571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:04.843056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:04.843489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:04.844213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:04.844667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:04.845091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:04.930712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:04.938893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-95e95eab-1ea2-47d2-8cad-e7ff9d162ee3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.153313 Aug 24 09:30:04.939460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 145/282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:04 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:04.976326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:04.984839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-501a2ca9-3b5f-496a-9d61-011979d76344 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1314 microversion: 2.1 time: 0.154175 Aug 24 09:30:04.985403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 138/283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:04 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:05.960017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:05.960660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:05.967413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:05.967869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:05.968308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:05.969012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:05.969467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:05.969895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:06.005561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:06.006181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:06.012741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:06.013222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:06.013661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:06.014354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:06.014805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:06.015228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:06.107839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:06.115972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b496902c-489c-4476-9d56-b27427c63a6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.159683 Aug 24 09:30:06.116548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 146/284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:05 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:06.154388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:06.162030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4631eccd-98fe-467f-83e1-b9533cb5a28b tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1497 microversion: 2.1 time: 0.160199 Aug 24 09:30:06.162589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 139/285] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:06 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:07.137783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:07.138573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:07.145385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:07.145866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:07.146302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:07.146998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:07.147608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:07.148049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:07.238998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:07.239675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:07.246074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:07.246672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:07.247036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:07.247826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:07.248276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:07.248696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:07.279758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:07.285605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:30:07.288287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d2287ad2-7b45-4b8f-a6e9-5693c2e7ccb0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.154327 Aug 24 09:30:07.289021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 147/286] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:07 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:07.563489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2001b3b6-9d13-43c0-98f8-8f8093337c05 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "DELETE /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 204 len: 0 microversion: 2.1 time: 0.328580 Aug 24 09:30:07.564161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 140/287] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:30:07 2022] DELETE /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 24 09:30:07.574474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:07.574474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:07.579528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:07.580052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:07.580484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:07.581234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:07.581707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:07.582124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:07.586184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:07.733526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:07.734239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=18 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:07.849802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:07.857906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d2aa894a-7fb7-4404-bfb0-042c7af99d41 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.289455 Aug 24 09:30:07.858457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 148/288] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:07 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:08.310653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:08.311381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:08.313316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:08.318094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:08.318574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:08.319009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:08.319720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:08.320198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:08.320587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:08.446818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:08.454719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4cc8dc5a-081e-452d-adee-f72d5636e587 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.148230 Aug 24 09:30:08.455290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 141/289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:08 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:08.878758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:08.879363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:08.886830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:08.887309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:08.887771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:08.888452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:08.888897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:08.889312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:09.016951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:09.025165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-35d79c46-d400-43cc-b7df-3c75d05654b8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.150208 Aug 24 09:30:09.025723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 149/290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:08 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:09.477496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:09.478102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:09.485073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:09.485558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:09.485993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:09.486764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:09.487215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:09.487670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:09.616137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:09.623836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-063fe50c-ac82-4395-a3d4-8b8c55b6c9c3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.150466 Aug 24 09:30:09.624381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 142/291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:09 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:10.046539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:10.047235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:10.053921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:10.054637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:10.055148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:10.055868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:10.056319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:10.056744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:10.187704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:10.195270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a0913e82-49dd-4a49-8944-4bbcd7dc7fc8 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.153354 Aug 24 09:30:10.195856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 150/292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:10 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:10.645294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:10.646670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:10.664587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:10.666309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:10.666309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:10.667447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:10.667942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:10.671135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:10.820758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:10.828418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9046bdf0-f8b0-46a4-821a-d94847608559 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.188245 Aug 24 09:30:10.829002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 143/293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:10 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:11.218510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:11.219120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:11.225461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:11.225933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:11.226360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:11.227035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:11.227483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:11.227926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:11.363509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:11.371455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1e048608-87c2-4be8-a5d4-e680cc0b10c2 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.157466 Aug 24 09:30:11.372047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 151/294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:11 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:11.850251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:11.850826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:11.857464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:11.857948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:11.858387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:11.859074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:11.859528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:11.859976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:11.992986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:12.000653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e9f1f5fe-58e7-4cba-bd90-cc4802d96e86 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.154387 Aug 24 09:30:12.001220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 144/295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:11 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:12.393822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:12.394438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:12.401106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:12.401590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:12.402597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:12.403294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:12.403787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:12.404217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:12.537403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:12.545014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4c463a36-2b91-4167-af02-2b01f36ae10c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.155351 Aug 24 09:30:12.545562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 152/296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:12 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:13.021471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:13.022017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:13.028804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:13.029291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:13.029723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:13.030412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:13.030867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:13.031319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:13.156207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:13.163697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0610dedc-dae5-4c26-881e-2bf11b163152 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.146366 Aug 24 09:30:13.164251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 145/297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:13 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:13.566136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:13.566736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:13.574404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:13.574404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:13.575018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:13.575902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:13.576522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:13.576957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:13.671920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-d5d82eaf-941e-4898-ab99-428d0b39bb62 req-72c7433a-11a5-4436-bc36-9b1aa606e9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5343e07-144f-42bb-b966-2db846f99964", "name": "network-vif-plugged", "status": "completed", "tag": "3ebb5115-328b-42f9-b5fc-c02856ef0d4c"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:13.683627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d5d82eaf-941e-4898-ab99-428d0b39bb62 req-72c7433a-11a5-4436-bc36-9b1aa606e9d5 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:13.684273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d5d82eaf-941e-4898-ab99-428d0b39bb62 req-72c7433a-11a5-4436-bc36-9b1aa606e9d5 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:13.685768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d5d82eaf-941e-4898-ab99-428d0b39bb62 req-72c7433a-11a5-4436-bc36-9b1aa606e9d5 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:13.698250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-d5d82eaf-941e-4898-ab99-428d0b39bb62 req-72c7433a-11a5-4436-bc36-9b1aa606e9d5 service nova] Creating event network-vif-plugged:3ebb5115-328b-42f9-b5fc-c02856ef0d4c for instance a5343e07-144f-42bb-b966-2db846f99964 on hv-cinder-85032 Aug 24 09:30:13.704178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-d5d82eaf-941e-4898-ab99-428d0b39bb62 req-72c7433a-11a5-4436-bc36-9b1aa606e9d5 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035862 Aug 24 09:30:13.704993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 146/298] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:30:13.723906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:13.732057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ad7bec97-8d0f-427c-89c4-e37702a1108a tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.170120 Aug 24 09:30:13.732602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 153/299] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:13 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:14.189834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:14.190533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:14.196710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:14.197267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:14.198915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:14.198915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:14.198915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:14.199450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:14.337687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:14.345851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4b78c3ba-19cb-4295-b2fe-47d30d0eed12 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.160400 Aug 24 09:30:14.348139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 147/300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:14 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:14.752130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:14.752660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:14.758803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:14.761040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:14.761040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:14.761040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:14.761040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:14.762060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:14.893665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:14.901249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff722a9f-33a3-4b1b-8798-218f8d5333f9 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.153056 Aug 24 09:30:14.901812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 154/301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:14 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:15.366792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:15.367417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:15.373295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:15.373765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:15.374192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:15.374868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:15.375316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:15.375775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:15.502467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:15.510284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ac1726fb-c381-48dc-98a3-22515a3bf21b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.147411 Aug 24 09:30:15.510849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 148/302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:15 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:15.921642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:15.922252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:15.928460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:15.928964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:15.929391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:15.930069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:15.930517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:15.930933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:16.057162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:16.065280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e57f327e-bddb-4ffc-8206-518e4f8dac9e tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.147549 Aug 24 09:30:16.065829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 155/303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:15 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:16.531936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:16.531936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:16.539491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:16.540239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:16.540852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:16.541569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:16.542026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:16.542988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:16.682933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:16.686695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:16.691219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-84926f83-e748-43eb-b93b-ce3d2ff78de4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.164742 Aug 24 09:30:16.691819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 149/304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:16 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:17.086587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:17.087210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:17.093596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:17.094060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:17.094495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:17.095186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:17.095668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:17.096098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:17.227646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:17.235947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-19ea91fd-a3d9-4344-9e6c-624ad2987935 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.153518 Aug 24 09:30:17.236500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 156/305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:17 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:17.712632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:17.713239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:17.720336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:17.720811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:17.721240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:17.721918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:17.722367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:17.722897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:17.857688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:17.865482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-67781307-769b-4774-8877-f56dbeb01080 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.156970 Aug 24 09:30:17.866042 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 150/306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:17 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:18.256761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:18.257379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:18.264289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:18.264771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:18.265204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:18.265897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:18.266351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:18.266776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:18.395577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:18.403093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ccef4ca-d3df-427c-b96a-cd9b350f316c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.150152 Aug 24 09:30:18.405979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 157/307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:18 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:18.886525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:18.887158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:18.893602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:18.894072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:18.894500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:18.895177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:18.895938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:18.896367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:19.022460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:19.030327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f4f0cba6-14ce-449b-85a0-b4fe5b6eb43a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.147657 Aug 24 09:30:19.030943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 151/308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:18 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:19.423686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:19.424298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:19.430601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:19.431110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:19.431549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:19.432259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:19.432714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:19.433133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:19.564894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:19.573910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d9c2edd5-400c-4bea-b00e-9606846367ec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.154610 Aug 24 09:30:19.574662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 158/309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:19 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:20.050935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:20.051596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:20.057568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:20.058048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:20.058486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:20.059168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:20.060223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:20.060666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:20.192430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:20.199903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b7d7e3ba-f997-4d71-8f0e-039d1a836f74 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.152886 Aug 24 09:30:20.200578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 152/310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:20 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:20.594243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:20.594854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:20.602125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:20.602607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:20.603040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:20.603760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:20.604207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:20.604628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:20.736499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:20.739485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dc1f4321-38d1-4891-926d-07827c003b01 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.149160 Aug 24 09:30:20.740071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 159/311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:20 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:21.221689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:21.222295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:21.228565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:21.229254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:21.229899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:21.230582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:21.231040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:21.231459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:21.361098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:21.368650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4a673139-cb8f-4fd2-a4f5-4317eeeff3ce tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.150865 Aug 24 09:30:21.369192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 153/312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:21 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:21.766490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:21.767695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:21.776187 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:21.776813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:21.777252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:21.777950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:21.778401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:21.778829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:21.911218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:21.919328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-96847c1b-3677-427d-96c5-02f519cb4ed1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.160907 Aug 24 09:30:21.920137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 160/313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:21 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:22.389357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:22.390542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:22.396699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:22.397125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:22.397558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:22.398236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:22.398885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:22.399310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:22.533685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:22.541170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5b585944-26d3-4e26-93ac-7790d69da689 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.155710 Aug 24 09:30:22.541719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 154/314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:22 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:22.940017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:22.940626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:22.946887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:22.947435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:22.947839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:22.948554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:22.949007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:22.949430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:23.074449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:23.082729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-597a9be5-ccee-492b-a2b9-d05cc20989bc tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.146542 Aug 24 09:30:23.086761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 161/315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:22 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:23.562772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:23.563381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:23.569414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:23.569892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:23.570329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:23.571010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:23.571462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:23.571921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:23.698517 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:23.706027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d8d5e1f9-309c-4757-b324-6c8ce98e843b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.147675 Aug 24 09:30:23.706589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 155/316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:23 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:24.104917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:24.105530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:24.112646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:24.113125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:24.113559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:24.114245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:24.114742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:24.115164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:24.253000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:24.260595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-55fa2571-c66c-4a27-8041-b78e68a9e0a5 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.159713 Aug 24 09:30:24.261160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 162/317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:24 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:24.726448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:24.727083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:24.733056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:24.733530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:24.733958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:24.734633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:24.735081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:24.735501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:24.863065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:24.870640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d1117e07-87ec-4b8f-a184-873279dec405 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.148140 Aug 24 09:30:24.871195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 156/318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:24 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:25.281385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:25.281997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:25.288323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:25.288794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:25.289228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:25.289911 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:25.290359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:25.290777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:25.422048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:25.429665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-339d9317-a1d5-4e38-8617-25640ac8c4a1 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.152227 Aug 24 09:30:25.430230 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 163/319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:25 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:25.892408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:25.894577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:25.899268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:25.899917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:25.900370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:25.901071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:25.901532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:25.901968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:26.276355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:26.286523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-10e16c22-b053-4112-9e70-d4dd65cedae3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1321 microversion: 2.1 time: 0.397857 Aug 24 09:30:26.287319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 157/320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:25 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:26.451042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:26.452123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:26.454738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:26.459726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:26.460445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:26.461071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:26.461578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-0a7618aa-03e3-42a4-b0ff-36a49f2e7097 req-5c99f8d6-693e-4672-99d8-fc12898f9ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a2f38e-6e14-434b-a628-cacaecbb1492", "name": "network-vif-plugged", "status": "completed", "tag": "391ff95c-c037-4aa0-89d4-3d2d917b9473"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:26.462361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:26.462817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:26.463448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:26.477187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-0a7618aa-03e3-42a4-b0ff-36a49f2e7097 req-5c99f8d6-693e-4672-99d8-fc12898f9ca7 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:26.477867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-0a7618aa-03e3-42a4-b0ff-36a49f2e7097 req-5c99f8d6-693e-4672-99d8-fc12898f9ca7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:26.478430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-0a7618aa-03e3-42a4-b0ff-36a49f2e7097 req-5c99f8d6-693e-4672-99d8-fc12898f9ca7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:26.498955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-0a7618aa-03e3-42a4-b0ff-36a49f2e7097 req-5c99f8d6-693e-4672-99d8-fc12898f9ca7 service nova] Creating event network-vif-plugged:391ff95c-c037-4aa0-89d4-3d2d917b9473 for instance 10a2f38e-6e14-434b-a628-cacaecbb1492 on hv-cinder-85032 Aug 24 09:30:26.509225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-0a7618aa-03e3-42a4-b0ff-36a49f2e7097 req-5c99f8d6-693e-4672-99d8-fc12898f9ca7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053375 Aug 24 09:30:26.521029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 158/321] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:30:26.686099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:26.689606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:26.694605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dec4e455-d76d-4626-8a69-728e2520410c tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1503 microversion: 2.1 time: 0.248325 Aug 24 09:30:26.708256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 164/322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:26 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1503 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:26.964794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-9529ccc9-b9c3-4a3e-928b-17e28bee04a0 req-a440ded7-a674-4766-97b5-784cf7588a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "037c531a-e3a8-417e-91fc-edcd0465a15b", "name": "network-vif-deleted", "tag": "18c85969-a94c-46f4-aefc-3c7a3129d791"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:26.974840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-9529ccc9-b9c3-4a3e-928b-17e28bee04a0 req-a440ded7-a674-4766-97b5-784cf7588a30 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:26.975322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-9529ccc9-b9c3-4a3e-928b-17e28bee04a0 req-a440ded7-a674-4766-97b5-784cf7588a30 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:26.975795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-9529ccc9-b9c3-4a3e-928b-17e28bee04a0 req-a440ded7-a674-4766-97b5-784cf7588a30 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:26.986950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-9529ccc9-b9c3-4a3e-928b-17e28bee04a0 req-a440ded7-a674-4766-97b5-784cf7588a30 service nova] Creating event network-vif-deleted:18c85969-a94c-46f4-aefc-3c7a3129d791 for instance 037c531a-e3a8-417e-91fc-edcd0465a15b on hv-cinder-85032 Aug 24 09:30:26.991959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-9529ccc9-b9c3-4a3e-928b-17e28bee04a0 req-a440ded7-a674-4766-97b5-784cf7588a30 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031498 Aug 24 09:30:26.992524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 159/323] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:30:27.308115 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:27.308737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:27.315427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.316235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.316454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.317145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.317604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.318037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.451226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:27.459662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8a9ee34c-96d9-4629-a07e-c9cb8900ebc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1516 microversion: 2.1 time: 0.155697 Aug 24 09:30:27.460243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 165/324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:27 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:27.481975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:27.484251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:27.486199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:27.491061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.495189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.495189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.495189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.495189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.495752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.516926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lazy-loading 'flavor' on Instance uuid a5343e07-144f-42bb-b966-2db846f99964 {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:30:27.715845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:27.716565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:27.722445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.722921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.723351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.724068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.733202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.733202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.756019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.756492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.756918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.757356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lazy-loading 'fault' on Instance uuid 037c531a-e3a8-417e-91fc-edcd0465a15b {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:30:27.802117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:27.810283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-89533428-fca4-4290-b648-159e4c567cad tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1304 microversion: 2.1 time: 0.098571 Aug 24 09:30:27.810847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 166/325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:27 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1304 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:27.917789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-791e1fdc-034e-4a7d-889c-8a5084abdbdc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964/action" status: 200 len: 32 microversion: 2.1 time: 0.437942 Aug 24 09:30:27.917789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 160/326] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Aug 24 09:30:27 2022] POST /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964/action => generated 32 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:30:27.925887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:27.926513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:27.932476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.932955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.933391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:27.934084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:27.935048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:27.935476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:28.065594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:28.073321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7341a330-6b2c-4b22-9c75-0ecc3918556f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.151478 Aug 24 09:30:28.074174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 167/327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:27 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:28.831923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:28.832687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:28.840132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:28.840613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:28.841629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:28.842476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:28.843110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:28.843531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:28.875355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:28.875991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:28.876427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:28.876870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lazy-loading 'fault' on Instance uuid 037c531a-e3a8-417e-91fc-edcd0465a15b {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:30:28.920191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3cd284afb854b1e987e807127752925', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6204c9e825f841aab905eac66e6a4a1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:28.928319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-420f8d60-09fa-4c99-8e0b-631d3d4ac312 tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 200 len: 1304 microversion: 2.1 time: 0.100567 Aug 24 09:30:28.928884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 161/328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:28 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:29.096632 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:29.097331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:29.103814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:29.104287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:29.114283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:29.114283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:29.114283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:29.114283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:29.245033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:29.253504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-313eae2c-6ca5-4fb9-99ae-05f3a3d255c0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.160764 Aug 24 09:30:29.254308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 168/329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:29 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:29.962250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:29.962250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] [instance: 037c531a-e3a8-417e-91fc-edcd0465a15b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:29.968564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:29.969285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:29.970353 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:29.971069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:29.971530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:29.972052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:29.986534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] HTTP exception thrown: Instance 037c531a-e3a8-417e-91fc-edcd0465a15b could not be found. Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Request method failure captured: Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b HTTP/1.1 Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe9opo1_8KQW1Hlnm-HDwRlr8hB-HY_V_S-PKnzqn1F_Zeaen3_rpWKR8jNXYktuL_rLLx940VNA1No7R8_BvVn4fZWBRnERgrYZer8Lw-J11qoN-qrY7KarI8vaMd0-F_yofX-thgDQf2GXGeuC3Yoj977VhEdzNZT4Nrz_-g_0dVg Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 6204c9e825f841aab905eac66e6a4a1e Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-VolumesActionsTest-1111059467 Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:30:29.993409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/6204c9e825f841aab905eac66e6a4a1e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6204c9e825f841aab905eac66e6a4a1e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/6204c9e825f841aab905eac66e6a4a1e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_6204c9e825f841aab905eac66e6a4a1e", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-VolumesActionsTest-1111059467 Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 6204c9e825f841aab905eac66e6a4a1e Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-VolumesActionsTest-1111059467 Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-VolumesActionsTest-1111059467-project Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: b3cd284afb854b1e987e807127752925 Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-VolumesActionsTest-1111059467-project Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 037c531a-e3a8-417e-91fc-edcd0465a15b could not be found. Aug 24 09:30:29.994868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '037c531a-e3a8-417e-91fc-edcd0465a15b'} Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 037c531a-e3a8-417e-91fc-edcd0465a15b could not be found. Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:30:29.995629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 037c531a-e3a8-417e-91fc-edcd0465a15b could not be found. Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 037c531a-e3a8-417e-91fc-edcd0465a15b could not be found. Aug 24 09:30:29.996783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:30:29.997846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] Returning 404 to user: Instance 037c531a-e3a8-417e-91fc-edcd0465a15b could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:30:29.997846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b05354a8-be17-4920-a8bb-8c9da8de0cec tempest-VolumesActionsTest-1111059467 tempest-VolumesActionsTest-1111059467-project] 10.222.0.16 "GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b" status: 404 len: 111 microversion: 2.1 time: 0.044128 Aug 24 09:30:29.997846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 162/330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:29 2022] GET /compute/v2.1/servers/037c531a-e3a8-417e-91fc-edcd0465a15b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:30:30.274284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:30.275028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:30.282101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:30.282576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:30.283008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:30.283812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:30.284311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:30.284732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:30.444011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:30.452447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-201796d1-7645-4d42-a17f-27388d2e1741 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.182105 Aug 24 09:30:30.453812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 169/331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:30 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:31.474164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:31.475228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:31.480875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:31.481964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:31.482413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:31.483109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:31.483563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:31.484022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:31.618247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:31.626385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f6d8279f-2d44-467d-bba4-c36e9c5ff7a7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.155986 Aug 24 09:30:31.627187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 163/332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:31 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:32.648658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:32.649441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:32.657324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:32.658179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:32.658338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:32.659041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:32.659525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:32.659981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:32.806254 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:32.815447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1f5258f7-02d4-465c-ad96-f0b46465c826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.170822 Aug 24 09:30:32.816282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 170/333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:32 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:33.840921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:33.841534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:33.848494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:33.848969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:33.849434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:33.850114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:33.850563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:33.850982 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:33.986119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:33.993732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dd49b98e-b1a2-46d6-a298-1cd2ec405a96 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.156710 Aug 24 09:30:33.994283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 164/334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:33 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:35.015135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:35.015715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:35.022132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:35.022614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:35.023051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:35.023769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:35.024228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:35.024653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:35.157432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:35.165233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9c431445-c832-4184-9d4b-84c887f42acb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.154113 Aug 24 09:30:35.165853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 171/335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:35 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:36.186364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:36.186969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:36.192870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:36.193389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:36.198017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:36.198017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:36.198017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:36.198017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:36.321616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:36.329986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-27450c40-1008-45ba-8f07-5423237b558a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.147631 Aug 24 09:30:36.330533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 165/336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:36 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:37.352128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:37.352863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:37.359543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:37.360069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:37.360499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:37.361193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:37.361650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:37.362073 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:37.499696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:37.507379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-450f3b7b-1d13-466a-bc04-678225dc9a1a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.159405 Aug 24 09:30:37.507970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 172/337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:37 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:38.528400 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:38.529324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:38.535284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:38.535879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:38.536319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:38.537010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:38.537464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:38.537889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:38.542102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:38.674339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:38.682068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4a3d69be-faf0-4a0f-a51a-82faef09fbe0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.157516 Aug 24 09:30:38.682626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 166/338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:38 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:39.704694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:39.705346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:39.712382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:39.712913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:39.713298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:39.713994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:39.714443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:39.714864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:39.858682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:39.866922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-54832f5e-ee56-48a5-97f9-ca698309d359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.166395 Aug 24 09:30:39.871774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 173/339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:39 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:40.888844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:40.895347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:40.899138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:40.899466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:40.899979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:40.900927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:40.901393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:40.901816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:41.037823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:41.045813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-81dc9f5d-6790-4989-af6a-deaa97f7be8c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.160737 Aug 24 09:30:41.046386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 167/340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:40 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:42.066574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:42.067187 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:42.075355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:42.076098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:42.076760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:42.077798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:42.078131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:42.078601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:42.230481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:42.240624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9cfd78b9-65e9-4fa2-9883-47872a9b1049 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.178098 Aug 24 09:30:42.241492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 174/341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:42 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:43.199443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1158014805", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "networks": [{"uuid": "566d5bb4-7c4c-4940-85e8-ed4f65ae9bf6"}]}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:43.267400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:43.269072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:43.281839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] validate_networks() for [('566d5bb4-7c4c-4940-85e8-ed4f65ae9bf6', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:30:43.283646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:43.284385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:43.285057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:43.285761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:43.286374 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:43.286800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:43.604337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:43.619833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-56ec6843-f615-4581-b06d-9d83a20a20e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.361584 Aug 24 09:30:43.622415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 175/342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:43 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:43.853670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:30:43.854127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:30:43.854675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:30:43.855168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:30:43.855744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:30:43.875833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:43.876705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:43.878227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:43.879720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:43.880698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:43.881394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:43.912495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Getting quotas for project 0b3e1d0646174986919db290c6da2579. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:30:43.918272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Getting quotas for user bfc3f904a4fc4abc91e8df52ec816a0a and project 0b3e1d0646174986919db290c6da2579. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:30:43.939560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:30:43.943884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:30:44.115130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-635067e3-e5a6-4702-8197-8a4c5bba8dfc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.913014 Aug 24 09:30:44.115130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 168/343] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:30:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:30:44.120063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-feafcb1f-53e5-4fe2-84fb-5a4662882dc0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:44.121002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-feafcb1f-53e5-4fe2-84fb-5a4662882dc0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:44.208186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-feafcb1f-53e5-4fe2-84fb-5a4662882dc0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:44.216039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-feafcb1f-53e5-4fe2-84fb-5a4662882dc0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1219 microversion: 2.1 time: 0.099761 Aug 24 09:30:44.216602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 176/344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:44 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:44.649804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:44.651555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:44.660256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:44.661054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:44.662080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:44.662855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:44.663734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:44.664124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:44.900276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:44.914490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b5482b2a-24df-4022-9c74-8c95eea15150 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.271540 Aug 24 09:30:44.915085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 169/345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:44 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:45.241419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9e9b41f6-4581-4a86-9948-be54bb25943d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:45.242905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9e9b41f6-4581-4a86-9948-be54bb25943d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:45.311443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9e9b41f6-4581-4a86-9948-be54bb25943d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:45.322467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9e9b41f6-4581-4a86-9948-be54bb25943d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1219 microversion: 2.1 time: 0.087947 Aug 24 09:30:45.336162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 177/346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:45 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:45.936556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:45.937365 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:45.944849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:45.945470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:45.946025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:45.946842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:45.947408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:45.947971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:46.126809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:46.136823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-67b268ef-8a18-404c-be09-f0ee261c2c13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.204135 Aug 24 09:30:46.148170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 170/347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:45 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:46.343410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:46.347315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:46.365007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:46.370942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:46.370942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:46.370942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:46.370942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:46.371286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:46.450227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:46.460771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e5d57900-5dc9-4b6a-8245-12f2c945631e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1271 microversion: 2.1 time: 0.122108 Aug 24 09:30:46.462156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 178/348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:46 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1271 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:47.173605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:47.174203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:47.181988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:47.182485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:47.182920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:47.189026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:47.189636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:47.190083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:47.432804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:47.449173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c3c8e5fa-3aab-4394-a0cf-2c13a9275b63 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.279373 Aug 24 09:30:47.451622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 171/349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:47 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:47.484911 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:47.485553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:47.491929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:47.493158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:47.493158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:47.493696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:47.494152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:47.494578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:47.565267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:47.577132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1f402e38-3e62-46fb-906f-50b4bafddfca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1277 microversion: 2.1 time: 0.095788 Aug 24 09:30:47.582400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 179/350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:47 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1277 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:48.482925 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:48.484299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:48.492630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:48.493372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:48.493964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:48.494831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:48.495451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:48.497102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:48.606322 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:48.607557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:48.618722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:48.620742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:48.621418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:48.623618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:48.625609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:48.626294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:48.676153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:48.685551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6a6cdd7a-e9c9-492e-9e9b-03c356d2325a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.211050 Aug 24 09:30:48.686361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 172/351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:48 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:48.930425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:48.938252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-089394b3-7461-4986-95c5-74dfe9dfecf9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.335644 Aug 24 09:30:48.938908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 180/352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:48 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:49.513184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-d4c5d153-d0eb-4a68-a61b-afaaa3110944 req-59a90dd7-be51-4a4b-a06d-a52b775daff9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fca9f952-e8e8-425b-9f7b-cc3132ad26ce", "tag": "90b6cdf2-7f40-422d-a879-9d83ffb80aad"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:49.524340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d4c5d153-d0eb-4a68-a61b-afaaa3110944 req-59a90dd7-be51-4a4b-a06d-a52b775daff9 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:49.525117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d4c5d153-d0eb-4a68-a61b-afaaa3110944 req-59a90dd7-be51-4a4b-a06d-a52b775daff9 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:49.525976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d4c5d153-d0eb-4a68-a61b-afaaa3110944 req-59a90dd7-be51-4a4b-a06d-a52b775daff9 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:49.541048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-d4c5d153-d0eb-4a68-a61b-afaaa3110944 req-59a90dd7-be51-4a4b-a06d-a52b775daff9 service nova] Creating event network-changed:90b6cdf2-7f40-422d-a879-9d83ffb80aad for instance fca9f952-e8e8-425b-9f7b-cc3132ad26ce on hv-cinder-85032 Aug 24 09:30:49.546504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-d4c5d153-d0eb-4a68-a61b-afaaa3110944 req-59a90dd7-be51-4a4b-a06d-a52b775daff9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036925 Aug 24 09:30:49.547265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 173/353] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:30:49.706524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:49.708489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:49.714189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:49.714726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:49.715101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:49.715822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:49.716269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:49.716687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:49.944501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:49.959321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:49.960064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:49.961805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-019d2c01-8f2f-48ce-a906-7479a1dbc8b3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.259061 Aug 24 09:30:49.964805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 181/354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:49 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:49.969109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:49.970137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:49.972402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:49.973140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:49.973770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:49.974353 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:50.191902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:50.201689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9df1d347-e411-4dbf-bc01-125b85f32b29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.246678 Aug 24 09:30:50.216566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 174/355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:49 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:50.995232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:50.996792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:51.011116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:51.012513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:51.017390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:51.018140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:51.018624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:51.019147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:51.224175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:51.225912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:51.244176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:51.245065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:51.245742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:51.246972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:51.247888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:51.252343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:51.255546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:51.272558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-182d3ba0-90f6-400c-9aff-14e120310b87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.284498 Aug 24 09:30:51.284424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 182/356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:50 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:51.453419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:51.462733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-44e4cfea-2d73-4db0-a40d-9dcd294d803b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.243635 Aug 24 09:30:51.463660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 175/357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:51 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:52.306030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:52.306732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:52.313571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:52.314145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:52.314683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:52.315459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:52.316026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:52.316524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:52.320943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:52.483752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:52.505680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:52.505680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:52.506391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ed0410e3-b6fe-42e6-bf63-07fbe014000a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.197305 Aug 24 09:30:52.506391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 183/358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:52 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:52.511776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:52.512287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:52.512727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:52.519894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:52.520423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:52.520921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:52.712392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:52.724861 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3b0884b7-fd38-4675-ade8-6ad9e761b4d6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.238426 Aug 24 09:30:52.725816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 176/359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:52 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:30:53.513246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:53.513867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:53.520856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:53.521332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:53.521768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:53.522454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:53.522907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:53.523329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:53.649720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:53.658009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e3d02f6-e095-4344-b8e7-b729385d318a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.148722 Aug 24 09:30:53.658682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 184/360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:53 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:53.748256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:53.749770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:53.757568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:53.758467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:53.759055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:53.759803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:53.760260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:53.761387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:53.895814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:53.917103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:53.925584 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-65d9db86-71eb-4be9-92a3-b085bdc97590 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.181359 Aug 24 09:30:53.942967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 177/361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:53 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:54.680165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:54.680956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:54.699195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:54.699855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:54.700396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:54.701290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:54.702063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:54.702751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:54.867891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:54.877175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f3bbfbf6-1a22-4940-8a62-e65d5b4685e9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.201955 Aug 24 09:30:54.877984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 185/362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:54 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:54.956036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:54.957241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:54.961948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:54.967280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:54.968264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:54.968992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:54.970095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:54.971080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:54.971727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:55.161304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:55.170097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-07996465-43c3-4c2a-88c7-42c7a9bd2d7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.222725 Aug 24 09:30:55.170871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 178/363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:54 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:55.906351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:55.907563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:55.911053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:55.920692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:55.921462 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:55.922489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:55.923497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:55.924240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:55.924741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:56.119797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:56.148241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-73288ff5-ca2e-4fb5-8442-5f684e418333 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.249320 Aug 24 09:30:56.149534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 186/364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:55 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:56.192230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:56.192943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:56.199188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:56.199802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:56.200238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:56.201123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:56.211689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:56.211689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:56.364963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:56.373366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-510755cd-8a82-4044-b479-2bac67e1e5ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.185396 Aug 24 09:30:56.379994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 179/365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:56 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:56.947411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-d0ed9789-1741-4438-80a2-6afc13f925da req-a98a222f-74b6-444f-a816-49e4d621793c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca9f952-e8e8-425b-9f7b-cc3132ad26ce", "name": "network-vif-plugged", "status": "completed", "tag": "90b6cdf2-7f40-422d-a879-9d83ffb80aad"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:30:56.953067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:56.958733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d0ed9789-1741-4438-80a2-6afc13f925da req-a98a222f-74b6-444f-a816-49e4d621793c service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:56.959376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d0ed9789-1741-4438-80a2-6afc13f925da req-a98a222f-74b6-444f-a816-49e4d621793c service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:56.959865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d0ed9789-1741-4438-80a2-6afc13f925da req-a98a222f-74b6-444f-a816-49e4d621793c service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:56.971608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-d0ed9789-1741-4438-80a2-6afc13f925da req-a98a222f-74b6-444f-a816-49e4d621793c service nova] Creating event network-vif-plugged:90b6cdf2-7f40-422d-a879-9d83ffb80aad for instance fca9f952-e8e8-425b-9f7b-cc3132ad26ce on hv-cinder-85032 Aug 24 09:30:56.976937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-d0ed9789-1741-4438-80a2-6afc13f925da req-a98a222f-74b6-444f-a816-49e4d621793c service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033678 Aug 24 09:30:56.977561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 187/366] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:30:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:30:57.177155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:57.179312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:57.189362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:57.198858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:57.199575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:57.205442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:57.206481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:57.207325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:57.399623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:57.400904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:57.408587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:57.409238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:57.409949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:57.410781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:57.411483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:57.412044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:57.445271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:57.457209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0cf22cdc-0334-4e26-982d-910a9a0e28c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.284979 Aug 24 09:30:57.458442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 180/367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:57 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:57.684055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:57.693603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-46bd5638-c63f-4404-b208-40784444dc6e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.300206 Aug 24 09:30:57.694517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 188/368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:57 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:58.480110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:58.480669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:58.482742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:30:58.488138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:58.494347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:58.494347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:58.494347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:58.494347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:58.494962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:58.662455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:58.671061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d3aace14-665a-48f0-89dd-ca78c582c71c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.194787 Aug 24 09:30:58.672230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 181/369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:58 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:58.718472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:58.718999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:58.727602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:58.728285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:58.729122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:58.730245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:58.730838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:58.731494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:58.908228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:58.919499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c13049b4-085a-49ab-8f0c-069dcffac973 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.208992 Aug 24 09:30:58.920662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 189/370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:58 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:59.694762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:59.695396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:59.701379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:59.701728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:59.702163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:59.702890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:59.703367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:59.703838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:59.846975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:30:59.855673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cbac1cd5-7402-4303-8146-9f3dac39fa85 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.165064 Aug 24 09:30:59.859372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 182/371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:59 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:30:59.940918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:30:59.941538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:30:59.949554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:59.950045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:59.950532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:30:59.951238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:30:59.951698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:30:59.952299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:00.135211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:00.143622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-75934e5d-5a33-47d1-b302-47a2d0cc8430 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1319 microversion: 2.1 time: 0.206891 Aug 24 09:31:00.157774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 190/372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:30:59 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:00.881372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:00.881929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:00.888144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:00.888623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:00.889056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:00.889744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:00.890200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:00.890623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:01.020341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:01.028067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0b496d06-8bb1-43d9-9990-fcf3124f6ea3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.150721 Aug 24 09:31:01.028647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 183/373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:00 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:01.164290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:01.164837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:01.171145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:01.171645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:01.172589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:01.173272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:01.173725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:01.174147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:01.301298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:01.309767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-60e9086b-9dd1-4e31-a58c-8f93cdf6094b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1508 microversion: 2.1 time: 0.149168 Aug 24 09:31:01.310325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 191/374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:01 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:02.051826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:02.051826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:02.057142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:02.057142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:02.057355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:02.058024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:02.058481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:02.058901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:02.063283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:02.273112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:02.280916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-770a7d66-1b70-44a8-b833-4861688e41a6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.236159 Aug 24 09:31:02.281480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 184/375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:02 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:03.302216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:03.303948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:03.310509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:03.312755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:03.312755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:03.312755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:03.312755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:03.313101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:03.457094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:03.464770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-20fca92f-091c-49ab-8eba-03aec0417d7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.167476 Aug 24 09:31:03.467624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 192/376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:03 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:04.489389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:04.490623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:04.497119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:04.497629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:04.498049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:04.498757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:04.499217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:04.499684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:04.628559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:04.636361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-962ac6f7-0554-4806-9ed8-390e3f9fa52a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.153688 Aug 24 09:31:04.636933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 185/377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:04 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:05.659485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:05.660257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:05.666826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:05.667313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:05.667788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:05.668501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:05.668955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:05.670007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:05.819304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:05.829944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-14b9b534-c8ea-42e5-bf33-7453b2b1577a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.174845 Aug 24 09:31:05.830443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 193/378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:05 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:06.851998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:06.852625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:06.858608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:06.859072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:06.859506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:06.860226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:06.860762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:06.861288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:06.998015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:07.005707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fc45681d-467d-49e6-a547-a0993d7a7b7e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.157557 Aug 24 09:31:07.006268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 186/379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:06 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:08.026429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:08.027051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:08.033993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:08.034603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:08.035149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:08.035996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:08.036563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:08.037183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:08.180533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:08.193677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1ec39834-5d0d-4d49-9596-d32bfb437d13 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.170987 Aug 24 09:31:08.194889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 194/380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:08 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:09.215997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:09.216612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:09.223066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:09.223650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:09.224099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:09.224787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:09.225241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:09.225666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:09.356685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:09.364364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4a2f3edf-01c4-4839-941d-31576776a59b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.152609 Aug 24 09:31:09.364927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 187/381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:09 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:10.385197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:10.385734 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:10.392160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:10.392631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:10.393059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:10.393732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:10.394177 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:10.394594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:10.521264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:10.528879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1093dd54-c758-44d3-bea2-9b3e87ace89e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.147666 Aug 24 09:31:10.529436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 195/382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:10 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:11.551231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:11.551902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:11.557967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:11.558457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:11.558949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:11.559691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:11.560152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:11.560580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:11.701880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:11.711642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4f01fe6f-be7e-4a5a-8888-1db71a72a42b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.164538 Aug 24 09:31:11.712250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 188/383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:11 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:12.732723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:12.733343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:12.740751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:12.741236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:12.741672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:12.742377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:12.742832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:12.743260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:12.876761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:12.885849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-63d8dfeb-6b7d-4160-9f2c-25c6bd27afb6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.157124 Aug 24 09:31:12.886426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 196/384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:12 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:13.906243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:13.906937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:13.912765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:13.913228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:13.913661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:13.914380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:13.914834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:13.915262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:14.046375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:14.054389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0fd1808f-8ad5-45f6-acae-13f03c138dd9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1522 microversion: 2.1 time: 0.152057 Aug 24 09:31:14.054959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 189/385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:13 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:15.076050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:15.076664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:15.083561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:15.084077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:15.084544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:15.085232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:15.085696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:15.086112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:15.214834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:15.222607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0f1223e2-264f-4ba5-92be-61497be83359 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1502 microversion: 2.1 time: 0.150389 Aug 24 09:31:15.223184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 197/386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:15 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:15.242440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:15.243064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:15.248992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:15.249477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:15.249918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:15.250627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:15.251070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:15.251498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:15.382745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:15.391236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f292b4ab-f711-48e6-b49b-15e0bbda5293 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1516 microversion: 2.1 time: 0.152790 Aug 24 09:31:15.391826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 190/387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:15 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:21.297220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:21.299422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:21.306012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:21.306531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:21.306971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:21.307694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:21.308150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:21.308576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:21.331121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lazy-loading 'flavor' on Instance uuid 10a2f38e-6e14-434b-a628-cacaecbb1492 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:31:21.426124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:31:21.426674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:31:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:31:21.462060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:21.600457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ce1f8f9a-cfb9-4e07-bd9f-82b0f7f7f72f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492/action" status: 200 len: 32 microversion: 2.1 time: 0.307042 Aug 24 09:31:21.601063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 198/388] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Aug 24 09:31:21 2022] POST /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492/action => generated 32 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 09:31:21.610572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:21.612438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:21.618536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:21.619030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:21.619471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:21.620345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:21.620916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:21.621606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:21.760032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:21.768255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-53cf295c-39f4-46ab-ae41-807cad5fb6c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.161494 Aug 24 09:31:21.768922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 191/389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:21 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:22.789525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:22.790229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:22.797479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:22.798073 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:22.798551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:22.799267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:22.799742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:22.800174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:22.937469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:22.952721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d1da4e34-50a9-4b6e-af3d-a4cdc4459b75 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.167502 Aug 24 09:31:22.953276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 199/390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:22 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:23.978231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:23.986838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:23.991345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:23.991818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:24.004731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:24.006271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:24.006758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:24.007758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:24.149732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:24.157858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3d2090b0-8cb9-40d2-a276-cffad99c723a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.184154 Aug 24 09:31:24.158408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 192/391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:23 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:25.179779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:25.181150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:25.188143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:25.188860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:25.189461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:25.190371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:25.190977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:25.192140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:25.594095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:25.602754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-de67a26a-f2db-4584-b5f8-6c9669792c7c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.427604 Aug 24 09:31:25.603423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 200/392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:25 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:26.627622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:26.628480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:26.634880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:26.635376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:26.635934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:26.636828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:26.637473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:26.637976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:26.864747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:26.875317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-09a2fb2c-96bd-40c4-9b1c-dd23c472094c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.254754 Aug 24 09:31:26.889138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 193/393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:26 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:27.896949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:27.897596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:27.906068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:27.907534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:27.911959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:27.912405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:27.913362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:27.914162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:27.914777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:28.074466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:28.083968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5f1fd0de-f781-4cf9-a54e-18d69abb111f tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.190786 Aug 24 09:31:28.086715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 201/394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:27 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:29.104765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:29.105550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:29.107503 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=26 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:29.112566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:29.113883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:29.114526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:29.115455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:29.116043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:29.116598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:29.362383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:29.370668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0a96b073-000c-4024-9f9a-35b4663a2693 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.269838 Aug 24 09:31:29.371235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 194/395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:29 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:30.046001 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:31:30.046592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:31:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:31:30.396228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:30.398073 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:30.405553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:30.406408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:30.407212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:30.408395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:30.408913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:30.409412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:30.575955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:30.587750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-01df3e63-a7cd-4ae1-a5da-2360422e1c1d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.194607 Aug 24 09:31:30.600672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 202/396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:30 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:31.608642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:31.610610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:31.616115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:31.616706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:31.617147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:31.617847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:31.618300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:31.618727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:31.881151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:31.889594 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f841f517-8a12-432c-a2ec-560313b4ebb5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.284702 Aug 24 09:31:31.890508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 195/397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:31 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:32.913184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:32.913865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:32.921512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:32.922046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:32.922611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:32.923364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:32.924057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:32.924531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:33.184759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:33.194631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-40ea1d42-a35b-4633-a565-e12fd2b1c208 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.286143 Aug 24 09:31:33.195971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 203/398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:32 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:34.218528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:34.219176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:34.229785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:34.230552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:34.231945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:34.232855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:34.234943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:34.235685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:34.261493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=71 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:34.408399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:34.417189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-93d7f3f9-6f28-4fbd-83a4-033dfb575b9c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.203110 Aug 24 09:31:34.418166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 196/399] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:34 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:35.438486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:35.439012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:35.445997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:35.446489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:35.446931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:35.447672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:35.448127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:35.448757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:35.609250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:35.619032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-97099e46-0e1c-4f4a-8c32-97c3088e83ba tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.183407 Aug 24 09:31:35.619032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 204/400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:35 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:36.644789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:36.646776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:36.657136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:36.657837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:36.658546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:36.659526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:36.660224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:36.660657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:36.931915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:36.942445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-99d5bb88-6fbf-44e9-8c5b-9e4e38791dc1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.307710 Aug 24 09:31:36.946760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 197/401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:36 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:37.354263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-118ba126-fc07-47f1-8c3d-9f995c7f701d tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] Action: 'create', calling method: .version_select at 0x7fa912f69e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-361727661", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMfxgv4R3BzLoFdEraRa2Ed4Ht9USW1lOGYMZ6i+OL9AWCL1LilGy2O4+9P8EpXsspHOWf9aNxCh8CdUTzzs8pENQ5pJgXyGktV6pYHNugcyEMtZx+z5n4FyP0rl/hAyA=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:37.371475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-118ba126-fc07-47f1-8c3d-9f995c7f701d tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] Getting quotas for project 4934cbcf5e1448fc826068c0779252b3. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:31:37.375969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-118ba126-fc07-47f1-8c3d-9f995c7f701d tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] Getting quotas for user e09379db7745459e94c671589ba2f6fd and project 4934cbcf5e1448fc826068c0779252b3. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:31:37.461320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-118ba126-fc07-47f1-8c3d-9f995c7f701d tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.311081 Aug 24 09:31:37.462349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 205/402] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 09:31:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:31:37.967537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:37.970585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:37.975275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:37.975800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:37.976296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:37.977009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:37.977465 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:37.977888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:38.125771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:38.135416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6cc82e99-07b4-4134-a250-4b9ac06b6cfc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.172514 Aug 24 09:31:38.136216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 198/403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:37 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:39.156654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:39.157260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:39.164011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:39.164486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:39.164917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:39.165635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:39.166081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:39.166501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:39.318075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:39.325924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fdf743d7-2640-4d86-890c-c439e194fd0b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.173614 Aug 24 09:31:39.327018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 206/404] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:39 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:40.348281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:40.348832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:40.354967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.355458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.355934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.356645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.357216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.357541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.509539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:40.517187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-aaa41554-631f-443b-895c-53959966c12c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1502 microversion: 2.1 time: 0.173543 Aug 24 09:31:40.517753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 199/405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:40 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:40.539053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75495702-1be5-4853-8299-00af4ca7e1d2"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:40.541432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:40.548188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.548646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.549076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.550017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.550499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.550922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.574777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] HTTP exception thrown: Cannot 'attach_volume' instance 10a2f38e-6e14-434b-a628-cacaecbb1492 while it is in vm_state rescued Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Request method failure captured: Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492/os-volume_attachments HTTP/1.1 Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 74 Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe-TECnAWFRqk2BJPqP2-p2HZ2FIj0WbaJcg1hsSoR_01ATvBuGQsE333CvTIF8qCC0WCHeY5-ncjWowna-FLVg79rgVXhG6K2RKGz0YWWlGzvC_O_G9ojDislDHFa_l6hBwzvYWFCYNDcoLSkGsGJ_BAfxairf-5mWS-TLdNMROQLs Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:31:40.576471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a0a723d97d24385875a287252f57f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a0a723d97d24385875a287252f57f02", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: 0aff36cf71984238b8a9b998043ec7be Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {"volumeAttachment": {"volumeId": "75495702-1be5-4853-8299-00af4ca7e1d2"}} Aug 24 09:31:40.583074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Cannot 'attach_volume' instance 10a2f38e-6e14-434b-a628-cacaecbb1492 while it is in vm_state rescued Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'server_id': '10a2f38e-6e14-434b-a628-cacaecbb1492', 'body': {'volumeAttachment': {'volumeId': '75495702-1be5-4853-8299-00af4ca7e1d2'}}} Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10a2f38e-6e14-434b-a628-cacaecbb1492 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:31:40.584004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 10a2f38e-6e14-434b-a628-cacaecbb1492 while it is in vm_state rescued Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:31:40.585413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:31:40.587093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:31:40.587093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:31:40.587093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 10a2f38e-6e14-434b-a628-cacaecbb1492 while it is in vm_state rescued Aug 24 09:31:40.587093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:31:40.587093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Returning 409 to user: Cannot 'attach_volume' instance 10a2f38e-6e14-434b-a628-cacaecbb1492 while it is in vm_state rescued {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:31:40.587093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-86135cac-939b-4192-bc5b-0fe08d1b8b37 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042884 Aug 24 09:31:40.587093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 207/406] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 09:31:40 2022] POST /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 24 09:31:40.587648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:40.588174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:40.594228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.594805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.595249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.596204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.596668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.597425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.816972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e13ad2de-48c3-4fb7-9510-e7d7696cc2cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492/action" status: 202 len: 0 microversion: 2.1 time: 0.233369 Aug 24 09:31:40.817600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 200/407] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Aug 24 09:31:40 2022] POST /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 09:31:40.825687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:40.826356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:40.833009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.833479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.834012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.834607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:40.835069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:40.835486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:40.969636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:40.977515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2fcda723-8ab6-4c63-8d2f-4add9d97b7b9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1510 microversion: 2.1 time: 0.155591 Aug 24 09:31:40.978071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 208/408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:40 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:41.999747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:42.001404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:42.007514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:42.008042 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:42.008483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:42.009180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:42.009635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:42.010057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:42.156016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:42.164351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-68ae8c32-6ac1-4eb9-b596-7da6300b07de tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1510 microversion: 2.1 time: 0.169168 Aug 24 09:31:42.164913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 201/409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:41 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1510 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:43.186865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:43.187474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:43.194418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:43.194891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:43.195324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:43.196042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:43.196493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:43.196914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:43.331359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:43.339409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-27473d6d-7dcb-40cf-9a36-d34fcb3bac9a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1510 microversion: 2.1 time: 0.156484 Aug 24 09:31:43.339984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 209/410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:43 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:44.360264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:44.360876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:44.366779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:44.367264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:44.367729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:44.368419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:44.368874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:44.369494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:44.498682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:44.507522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6ee0cb05-d2ca-4399-af9f-60f576dff537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1510 microversion: 2.1 time: 0.151021 Aug 24 09:31:44.508136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 202/411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:44 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1510 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:45.446299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d004b1e-0f53-4d5e-80dc-8d12597edb13", "device": "/dev/sdb"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:45.449740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:45.458938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:45.458938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:45.458938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:45.458938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:45.459358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:45.459358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:45.528847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:45.533598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:45.535884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:45.536402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:45.537002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:45.538225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:45.538926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:45.539396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:45.678130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:45.686168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6d222223-66f0-46f6-991f-948a2669ca5b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1510 microversion: 2.1 time: 0.161230 Aug 24 09:31:45.686728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 203/412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:45 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:46.622714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-681e855c-e628-4e70-ac7e-1587ae974a8a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "POST /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.181884 Aug 24 09:31:46.623406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 210/413] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 09:31:45 2022] POST /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce/os-volume_attachments => generated 194 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:31:46.707527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:46.708169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:46.714545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:46.715038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:46.715472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:46.716200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:46.716653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:46.718254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:46.849458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:46.857422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-aaaf7574-46b0-474b-81fa-9c8c68ff99c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1516 microversion: 2.1 time: 0.153856 Aug 24 09:31:46.857979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 204/414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:46 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:49.728743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:49.733275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0179ad12-2e82-416a-9ed4-317a08617cc6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'create', calling method: .version_select at 0x7fa91804a9d0>, body: {"keypair": {"name": "tempest-keypair-1797110528", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRmbFNYtBDdHVyNMOqYDf5qg2jnWczqEENDxwNmUR1yjRP1C+GPPcOlFmiaFwlvfdNO1PeuRroGMfOXIg3Itu4AyzRsfslCJZyjA4N/MspC6+24mKNDTAGj6jofwgdGfg=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:49.749420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-0179ad12-2e82-416a-9ed4-317a08617cc6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for project 7a0a723d97d24385875a287252f57f02. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:31:49.753477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-0179ad12-2e82-416a-9ed4-317a08617cc6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for user 0aff36cf71984238b8a9b998043ec7be and project 7a0a723d97d24385875a287252f57f02. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:31:49.849857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0179ad12-2e82-416a-9ed4-317a08617cc6 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122390 Aug 24 09:31:49.850622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 211/415] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 09:31:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:31:51.293689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:51.294403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:51.306633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:51.307161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:51.307614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:51.308326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:51.308769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:51.309189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:51.339016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-81445870-9f88-4097-a13a-7c5e35762584 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/ips" status: 200 len: 151 microversion: 2.1 time: 0.049367 Aug 24 09:31:51.343926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 205/416] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 09:31:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/ips => generated 151 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:31:51.900623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:51.901251 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:51.908744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:51.910259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:51.910259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:51.910470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:51.911396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:51.911846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:51.916545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=71,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:51.937143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2a946d91-645a-421a-9fa0-1b5693b1ea35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/ips" status: 200 len: 153 microversion: 2.20 time: 0.041101 Aug 24 09:31:51.944501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 212/417] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Aug 24 09:31:51 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/ips => generated 153 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:31:52.196187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1572126166", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0a761d3a-9d39-4f90-b3ef-cc43d1b998c8"}], "security_groups": [{"name": "tempest-securitygroup--1758598832"}], "key_name": "tempest-keypair-1797110528", "user_data": "}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:52.308906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] validate_networks() for [('0a761d3a-9d39-4f90-b3ef-cc43d1b998c8', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:31:52.701764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:31:52.702187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:31:52.702662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:31:52.703068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:31:52.703486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:31:52.713391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:52.713874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:52.714311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:52.715041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:52.717380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:52.717380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:52.736231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for project 7a0a723d97d24385875a287252f57f02. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:31:52.745979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Getting quotas for user 0aff36cf71984238b8a9b998043ec7be and project 7a0a723d97d24385875a287252f57f02. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:31:52.752012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:31:52.754315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:31:52.889567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-10c56c0b-7781-4cf2-91b5-17598567e0c5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.697791 Aug 24 09:31:52.890201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 206/418] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:31:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:31:52.901476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b369a6de-e80f-4b57-8e04-e54e4d9d8718 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:52.902231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b369a6de-e80f-4b57-8e04-e54e4d9d8718 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:52.956941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b369a6de-e80f-4b57-8e04-e54e4d9d8718 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:52.964045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b369a6de-e80f-4b57-8e04-e54e4d9d8718 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1246 microversion: 2.1 time: 0.066653 Aug 24 09:31:52.964601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 213/419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:52 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:53.990364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:53.991124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:53.996980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:53.998801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:53.998801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:53.998801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:53.999090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:53.999448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:54.060593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:54.068626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-74229b5a-c1fc-4bc5-b74d-e1bc8d9055d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1250 microversion: 2.1 time: 0.082182 Aug 24 09:31:54.069181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 207/420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:53 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1250 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:54.173272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "156aab15-cc6b-4aab-a58a-d47c2269e0c4"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:54.175555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:54.183393 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:54.183917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:54.184359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:54.185055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:54.185514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:54.185944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:55.091315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:55.091953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:55.098427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:55.099531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:55.101532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:55.101532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:55.101532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:55.101855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:55.175735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:55.192285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1015d473-c2c7-4875-bcc1-ac833a1114ab tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1242 microversion: 2.1 time: 0.105875 Aug 24 09:31:55.193054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 208/421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:55 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:31:55.686375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c134e2b8-a33f-4d73-acea-e2ccd486f0ff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.516728 Aug 24 09:31:55.691490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 214/422] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 09:31:54 2022] POST /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 194 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:31:56.216680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:56.217305 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:56.223238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:56.224270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:56.224716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:56.225408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:56.225865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:56.226291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:56.290495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:56.303114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-568a1c9f-c93c-45c6-9ecc-f8671ff8c46c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1298 microversion: 2.1 time: 0.090418 Aug 24 09:31:56.304081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 209/423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:56 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1298 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:56.360766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:56.361471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:56.368198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:56.368677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:56.369108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:56.369794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:56.370271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:56.370690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:56.394235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lazy-loading 'flavor' on Instance uuid 9e093c82-b762-45aa-840b-26b6b982f8bc {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:31:56.945296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a6cb8330-5714-4f98-9366-ddaaf788f47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "POST /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/action" status: 202 len: 0 microversion: 2.20 time: 0.589096 Aug 24 09:31:56.949282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 215/424] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Aug 24 09:31:56 2022] POST /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:31:56.964424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:56.965389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:56.972836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:56.974806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:56.975361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:56.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:56.977339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:56.978085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:57.185366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:57.193710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:57.195283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:57.196639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cc88ed3d-7313-4d36-aae3-708ff2a4a491 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.244666 Aug 24 09:31:57.197425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 210/425] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:31:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:31:57.324228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:57.325184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:57.331612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:57.332511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:57.332764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:57.333991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:57.334455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:57.334886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:57.438036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:57.446197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0f9a704e-7710-4064-a1d6-28ab78200898 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1304 microversion: 2.1 time: 0.126269 Aug 24 09:31:57.446765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 216/426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:57 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:58.220009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:58.220632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:58.226856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:58.227392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:58.227864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:58.228615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:58.229073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:58.229500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:58.363235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:58.373705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:58.376079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:58.377272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-87635ebc-d740-47df-8e7f-b65c247d2bc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.161175 Aug 24 09:31:58.377822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 211/427] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:31:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:31:58.468513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:58.469062 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:58.471437 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:58.476909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:58.477392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:58.477878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:58.478580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:58.479080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:58.479510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:58.649562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:58.657447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dff93a0f-be8f-42f1-8e2b-80c03690a1cd tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.193005 Aug 24 09:31:58.658015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 217/428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:58 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:31:58.943389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-3eafee37-01bd-46af-8cde-d70539a33506 req-94e83e08-0a72-4007-a475-e31e37acb955 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e147f8-b859-4bd1-bb4e-568041201520", "tag": "f7a0b684-ee3d-4463-a53a-01d76f4dfaac"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:31:58.954163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-3eafee37-01bd-46af-8cde-d70539a33506 req-94e83e08-0a72-4007-a475-e31e37acb955 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:58.954765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-3eafee37-01bd-46af-8cde-d70539a33506 req-94e83e08-0a72-4007-a475-e31e37acb955 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:58.957371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-3eafee37-01bd-46af-8cde-d70539a33506 req-94e83e08-0a72-4007-a475-e31e37acb955 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:58.975884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-3eafee37-01bd-46af-8cde-d70539a33506 req-94e83e08-0a72-4007-a475-e31e37acb955 service nova] Creating event network-changed:f7a0b684-ee3d-4463-a53a-01d76f4dfaac for instance f2e147f8-b859-4bd1-bb4e-568041201520 on hv-cinder-85032 Aug 24 09:31:58.981005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-3eafee37-01bd-46af-8cde-d70539a33506 req-94e83e08-0a72-4007-a475-e31e37acb955 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045393 Aug 24 09:31:58.981753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 212/429] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:31:59.401075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:59.402033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:59.407869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:59.408352 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:59.408785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:59.409474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:59.409922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:59.410344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:59.625398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:59.634270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:59.635818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:59.636987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-570263ed-ab88-4751-9d70-8fbd53eca349 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.239998 Aug 24 09:31:59.637546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 218/430] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:31:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:31:59.679882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:31:59.680501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:31:59.682409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.687183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:59.687730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:59.688176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:59.688923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:31:59.689382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:31:59.689802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:31:59.704736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:31:59.825884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:31:59.833922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3ac96859-367a-4016-97a1-ad514c299684 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.158857 Aug 24 09:31:59.834482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 213/431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:31:59 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:00.658452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:00.659058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:00.666086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:00.666558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:00.666987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:00.667690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:00.668142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:00.668560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:00.798359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:00.807796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:00.809294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:00.810449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-695cd489-5d37-4293-9547-11e86f430165 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155877 Aug 24 09:32:00.811018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 219/432] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:00.855382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:00.856079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:00.862307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:00.862805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:00.863648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:00.864393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:00.865551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:00.866155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:00.993460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:01.001480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-63e6dbd3-ed58-4c65-971b-bc60163af31b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.149943 Aug 24 09:32:01.002036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 214/433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:00 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:01.441969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:01.442460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:01.449066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:01.449555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:01.449990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:01.450682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:01.451139 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:01.451563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:01.474841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7b6c69ac-f9d1-4ca7-b1ba-fb1d4ee91569 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208/ips" status: 200 len: 144 microversion: 2.1 time: 0.036738 Aug 24 09:32:01.475408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 220/434] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 09:32:01 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:32:01.832237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:01.832845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:01.839035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:01.839515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:01.839980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:01.840662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:01.841116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:01.841538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:01.969580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:01.977588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:01.979097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:01.980290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-521d7147-9dfc-4761-a8e1-e30dfe373363 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.151973 Aug 24 09:32:01.980851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 215/435] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:01 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:02.022006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:02.022620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:02.028892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:02.029372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:02.029823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:02.030498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:02.030952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:02.031377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:02.161738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:02.169857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9f6db598-d979-4aa3-9c53-1ffb8cf38bb1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.151711 Aug 24 09:32:02.170413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 221/436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:02 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:03.002638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:03.003342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:03.005326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.006150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.011432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:03.011924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:03.012355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:03.013046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:03.013490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:03.013911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:03.145543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:03.159474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:03.159474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:03.159474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a5085710-ca06-428d-a462-d41aa5d46dc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.159183 Aug 24 09:32:03.159888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 216/437] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:03.191361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:03.191930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:03.195614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:03.199735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:03.200226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:03.200664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:03.201356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:03.201811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:03.202233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:03.339824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:03.347747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-82053034-e66c-4827-a193-be630919daf4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.160162 Aug 24 09:32:03.348386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 222/438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:03 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:04.179617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:04.180225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:04.186104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:04.186580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:04.187032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:04.187718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:04.188208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:04.188589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:04.318319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:04.326594 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:04.328086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:04.329240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8c7f0c7c-2c10-4f22-a60b-68e114f63aa7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.153611 Aug 24 09:32:04.329788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 217/439] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:04.368372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:04.368986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:04.375760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:04.376238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:04.376671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:04.377356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:04.377806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:04.378229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:04.509132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:04.516774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7356da29-5b77-4149-9222-5550953d0084 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.152261 Aug 24 09:32:04.517408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 223/440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:04 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:05.352901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:05.353509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:05.359671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:05.360155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:05.360617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:05.361311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:05.361763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:05.362185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:05.487164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:05.496543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:05.498234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:05.499411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2ffad49f-e415-4343-a991-856e62c8d47a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.150941 Aug 24 09:32:05.500001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 218/441] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:05.537908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:05.539303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:05.545986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:05.546471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:05.546910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:05.547636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:05.548172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:05.548498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:05.679257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:05.686804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7657e829-c97d-45d6-ad5a-1cfa95503d7d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.152714 Aug 24 09:32:05.687365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 224/442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:05 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:06.522184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:06.522742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:06.528709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:06.529182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:06.529612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:06.530293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:06.530737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:06.531165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:06.660370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:06.668974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:06.670489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:06.671685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bb496e60-3dd9-43f7-8bd0-ab57750006e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.153512 Aug 24 09:32:06.672244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 219/443] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:06.707319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:06.707973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:06.714582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:06.715061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:06.715500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:06.716235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:06.716696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:06.717123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:06.848274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:06.861285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1003eaae-6312-4a63-8686-46d55b993339 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.157843 Aug 24 09:32:06.861860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 225/444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:06 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:07.388333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-2e854260-f080-4b4c-b834-5e130e55ee81 req-3cc5446f-a62b-45ef-b845-787e16f3ad53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e147f8-b859-4bd1-bb4e-568041201520", "name": "network-vif-plugged", "status": "completed", "tag": "f7a0b684-ee3d-4463-a53a-01d76f4dfaac"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:32:07.398834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-2e854260-f080-4b4c-b834-5e130e55ee81 req-3cc5446f-a62b-45ef-b845-787e16f3ad53 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:07.399382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-2e854260-f080-4b4c-b834-5e130e55ee81 req-3cc5446f-a62b-45ef-b845-787e16f3ad53 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:07.399913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-2e854260-f080-4b4c-b834-5e130e55ee81 req-3cc5446f-a62b-45ef-b845-787e16f3ad53 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:07.411151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-2e854260-f080-4b4c-b834-5e130e55ee81 req-3cc5446f-a62b-45ef-b845-787e16f3ad53 service nova] Creating event network-vif-plugged:f7a0b684-ee3d-4463-a53a-01d76f4dfaac for instance f2e147f8-b859-4bd1-bb4e-568041201520 on hv-cinder-85032 Aug 24 09:32:07.418631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-2e854260-f080-4b4c-b834-5e130e55ee81 req-3cc5446f-a62b-45ef-b845-787e16f3ad53 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033920 Aug 24 09:32:07.419329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 220/445] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:32:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:32:07.695170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:07.695811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:07.701673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:07.702157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:07.702597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:07.703292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:07.703786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:07.704222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:07.849932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:07.858112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:07.859613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:07.860768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7058d03e-8ae5-42b1-80af-f7e71c92482e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.170142 Aug 24 09:32:07.861344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 226/446] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:07 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:07.883343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:07.884056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:07.890093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:07.890561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:07.890992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:07.891699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:07.892153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:07.892574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:08.023296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:08.031615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-508fedb7-6cc5-4695-926f-ec936a4031d1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.152879 Aug 24 09:32:08.032191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 221/447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:07 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:08.884535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:08.885225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:08.891918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:08.892399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:08.892831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:08.893516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:08.893961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:08.894446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:08.898231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:09.033040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:09.041763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:09.043255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:09.044475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-254973db-1d85-4d42-b5e3-fa47205e95cb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.164454 Aug 24 09:32:09.045034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 227/448] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:08 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:09.051933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:09.052628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:09.059377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:09.059889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:09.060387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:09.061079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:09.061532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:09.061957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:09.192994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:09.200679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-84b603a4-52cf-4aa3-add1-ec5379bd83fc tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.152565 Aug 24 09:32:09.201238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 222/449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:09 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:10.067278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:10.072899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:10.074367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:10.074853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:10.075292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:10.076011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:10.076469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:10.076893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:10.207246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:10.216680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:10.218068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:10.219184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9b8bdf6c-7597-490f-bd1b-b236f7b6374d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155942 Aug 24 09:32:10.219759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 228/450] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:10 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:10.221701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:10.222344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:10.228941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:10.229418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:10.229848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:10.230533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:10.230981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:10.231403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:10.362195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:10.370253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-40e62d62-5bea-4a19-af56-62e172c30065 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.152410 Aug 24 09:32:10.370815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 223/451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:10 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:11.242698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:11.243235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:11.249598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:11.250069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:11.250495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:11.251171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:11.251646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:11.252066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:11.391882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:11.392490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:11.394651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:11.398815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:11.399296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:11.399762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:11.400816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:11.401277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:11.401714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:11.402984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:11.404605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:11.408224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d5244e58-6ae5-4feb-b893-2acd0f3dc189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.167506 Aug 24 09:32:11.408224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 229/452] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:11 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:11.533107 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:11.541083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a91d52d6-482a-4806-9cd8-e2e3755efa2a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.153185 Aug 24 09:32:11.541641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 224/453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:11 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:12.427197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:12.427832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:12.434148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:12.434618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:12.435045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:12.435795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:12.436238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:12.436656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:12.561946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:12.562563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:12.563513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:12.568510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:12.568995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:12.569972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:12.570669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:12.571124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:12.571550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:12.572326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:12.573838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:12.574998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eed4cb91-79af-46f7-89d3-a510430164ea tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.151635 Aug 24 09:32:12.575557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 230/454] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:12.699612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:12.707390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b00fb562-8f1f-41f0-a2ef-c8746ed75583 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.149383 Aug 24 09:32:12.707998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 225/455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:12 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:13.598535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:13.599141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:13.606117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:13.606587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:13.607015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:13.607748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:13.608194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:13.608609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:13.728678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:13.729297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:13.735602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:13.736133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:13.736546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:13.737253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:13.737710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:13.738148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:13.740013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:13.748497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:13.750075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:13.751235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3a9cdb25-7292-4a61-88a0-8b8eca640aee tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.156656 Aug 24 09:32:13.752069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 231/456] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:13.883680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:13.891172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-731707ea-19e4-4141-88c3-106034ad8753 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.166890 Aug 24 09:32:13.891762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 226/457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:13 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:14.773752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:14.774367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:14.780850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:14.781333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:14.782092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:14.782465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:14.782918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:14.783347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:14.917824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:14.918984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:14.920549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:14.926509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:14.927623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:14.928138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:14.928313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:14.928568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:14.929260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:14.929819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0732881e-7236-4c47-96a7-a978aa3a5450 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.159798 Aug 24 09:32:14.929973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:14.930182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:14.930770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 232/458] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:15.067068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:15.076656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-594e6aa8-ba24-46bb-bdcd-c3a3b5d7b363 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.167301 Aug 24 09:32:15.077228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 227/459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:14 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:15.952903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:15.953508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:15.959852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:15.960324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:15.960816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:15.961769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:15.962220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:15.962637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:16.090720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:16.097082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:16.097757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:16.104789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:16.105277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:16.105723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:16.106424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:16.106967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:16.107095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:16.107411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:16.108494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:16.109675 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c811037d-60f8-4904-b4e0-118602196c79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.160641 Aug 24 09:32:16.110243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 233/460] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:15 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:16.234473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:16.242570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cf84475e-18f1-4a3a-80be-0a2e8db7aaa9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.148818 Aug 24 09:32:16.243136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 228/461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:16 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:17.131642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:17.132291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:17.138545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:17.139025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:17.139456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:17.140163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:17.140634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:17.141031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:17.262737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:17.263350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:17.269119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:17.269598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:17.270027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:17.271081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:17.271532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:17.271978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:17.272223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:17.280909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:17.282408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:17.283569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a952dde5-9150-46d9-9c3b-7dd240571478 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155782 Aug 24 09:32:17.284313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 234/462] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:17 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:17.400183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:17.407673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-05f9779a-f151-4c77-aa8c-a066d36901aa tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.148757 Aug 24 09:32:17.408227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 229/463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:17 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:18.306277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:18.306890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:18.313236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:18.313715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:18.314150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:18.314834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:18.315286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:18.315740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:18.427924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:18.428538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:18.434418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:18.434903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:18.436021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:18.436021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:18.436502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:18.436927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:18.446861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:18.458312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:18.459970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:18.471932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-55f94355-ae3d-4de0-aecc-bb199b01c934 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.159341 Aug 24 09:32:18.471932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 235/464] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:18.572689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:18.574944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:18.580987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2cd10605-37c5-4130-9a6d-6e5575d9b514 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.156988 Aug 24 09:32:18.581545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 230/465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:18 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:19.485522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:19.486171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:19.493197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:19.493690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:19.494105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:19.494796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:19.495244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:19.495690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:19.602187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:19.602792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:19.608782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:19.609261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:19.609688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:19.610374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:19.610820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:19.611240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:19.625500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:19.633817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:19.635347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:19.636576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-82fdac38-7879-49d0-9051-17d31b162a2e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.154948 Aug 24 09:32:19.637162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 236/466] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:19.735123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:19.743196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-06dfad98-afb4-4fe9-ab26-56daf4b01a87 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.145153 Aug 24 09:32:19.743783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 231/467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:19 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:20.659477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:20.660108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:20.666464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:20.666942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:20.667372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:20.668078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:20.668528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:20.668948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:20.764174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:20.764813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:20.770660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:20.771146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:20.771604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:20.772300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:20.772758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:20.773901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:20.795960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:20.804063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:20.805573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:20.806724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5819279d-7be8-41e9-8d3b-8cd3166c87ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.151169 Aug 24 09:32:20.807277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 237/468] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:20.897673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:20.905890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e49d158f-efea-4de9-b6bc-36ef764de788 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.145559 Aug 24 09:32:20.906445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 232/469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:20 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:21.829503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:21.830118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:21.837521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:21.837999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:21.838429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:21.839110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:21.839557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:21.840014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:21.926063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:21.926706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:21.932580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:21.933062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:21.933498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:21.934190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:21.934646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:21.935065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:21.970049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:21.979317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:21.980854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:21.982053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1564befb-8c5a-455d-83be-7134c6fe00fe tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.156433 Aug 24 09:32:21.982614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 238/470] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:21 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:22.062688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:22.070839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e6078a2b-be33-46b1-9569-810153be4eb8 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.148571 Aug 24 09:32:22.072096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 233/471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:21 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:23.003238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:23.003883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:23.010288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:23.010764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:23.011194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:23.011908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:23.012358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:23.012781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:23.092029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:23.092651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:23.098627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:23.099111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:23.099546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:23.100322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:23.100874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:23.101817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:23.149826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:23.158074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:23.159622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:23.160786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2d9c4fb5-6761-4274-8a78-59e5ca1bf713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.161421 Aug 24 09:32:23.164101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 239/472] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:23.234330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:23.243316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-98355b17-2ded-4677-b18e-ef50686fc2e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.155138 Aug 24 09:32:23.243916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 234/473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:23 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:24.184593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:24.185183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:24.191466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:24.191970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:24.192398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:24.193072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:24.193519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:24.193938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:24.263931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:24.264682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:24.270719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:24.271206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:24.271875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:24.272577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:24.273069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:24.273583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:24.324785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:24.343770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:24.345266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:24.346429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3bbc5c25-d774-4a3a-a988-cd88825381ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.165723 Aug 24 09:32:24.346972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 240/474] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:24 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:32:24.409567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:24.417730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a514b22c-4f09-498b-92e7-48a4f804835d tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.157797 Aug 24 09:32:24.418289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 235/475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:24 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:25.369031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:25.369641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:25.376087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:25.376568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:25.377001 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:25.377686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:25.378139 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:25.378560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:25.438300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:25.438916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:25.445486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:25.445969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:25.446415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:25.447105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:25.447558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:25.448023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:25.511696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:25.520803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:25.522280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:25.523713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-948011b9-3f1c-42a5-8ed1-211ebea9eb0b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.158469 Aug 24 09:32:25.539829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 241/476] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:25.580887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:25.589296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1990d85e-416f-47dc-ad14-980aaff4c9f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.154909 Aug 24 09:32:25.589848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 236/477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:25 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:26.558064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:26.558676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:26.564909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:26.565383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:26.565814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:26.566492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:26.566937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:26.567354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:26.612318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:26.613215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:26.625548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:26.625548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:26.625548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:26.625548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:26.625848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:26.625848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:26.706045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:26.714622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:26.716157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:26.717306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a284a10b-6ff2-4257-9003-45a499d6e94f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.163147 Aug 24 09:32:26.717861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 242/478] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:26.751241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:26.759241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3d8b71c0-448c-44a7-9027-468380bac887 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.151428 Aug 24 09:32:26.760010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 237/479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:26 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:27.739890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:27.740497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:27.747476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:27.747986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:27.748418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:27.749098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:27.749546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:27.749965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:27.779594 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:27.780220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:27.786045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:27.786527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:27.786958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:27.787937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:27.788393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:27.788930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:27.889475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:27.891679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:27.898758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:27.901370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:27.901615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e950e00d-b757-42a4-96e5-6b4e68d064ad tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.165318 Aug 24 09:32:27.902182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 243/480] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:27.919181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:27.926820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5af07936-9287-4d49-8b62-8076ca896764 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.151018 Aug 24 09:32:27.927367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 238/481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:27 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:28.924340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:28.924893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:28.927495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=54 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:28.932444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:28.932925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:28.933366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:28.934056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:28.934513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:28.934942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:28.948400 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:28.949011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:28.954742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:28.955229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:28.955708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:28.956398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:28.956860 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:28.957285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:29.066112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:29.074963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:29.076601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:29.077749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-606d9686-a615-4386-a279-b58b4ef9caf2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.157321 Aug 24 09:32:29.082327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 244/482] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:28 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:29.086098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:29.096710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f83fb9fa-fa33-4043-a1fa-768e1305cc1b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.150111 Aug 24 09:32:29.096710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 239/483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:28 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:30.101748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:30.102399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:30.108890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:30.109371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:30.109802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:30.110904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:30.111358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:30.111809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:30.115169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:30.115828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:30.119227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=54 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:30.122588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:30.125789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:30.125789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:30.125789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:30.125789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:30.126170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:30.244286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:30.252940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:30.254549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:30.255891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b53f581-2371-4d05-892e-00953223746b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.158365 Aug 24 09:32:30.256531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 245/484] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:30 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:30.463789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:30.471470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-36126b29-4e65-41b1-9895-d0660dc85feb tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.360021 Aug 24 09:32:30.472067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 240/485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:30 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:31.278673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:31.279278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:31.286028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:31.286485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:31.286916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:31.287621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:31.288072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:31.288979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:31.419005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:31.427241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:31.428774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:31.429928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a658242f-2f6d-4a87-9f09-eef29a1ddf28 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155160 Aug 24 09:32:31.430483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 246/486] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:31.492535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:31.493153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:31.499129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:31.499633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:31.500081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:31.500767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:31.501223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:31.501650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:31.626418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:31.633962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ba1b0c91-49b8-40ae-ab1f-a1f55fb22844 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.145267 Aug 24 09:32:31.634521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 241/487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:31 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:32.452758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:32.453374 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:32.459817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:32.460302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:32.460741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:32.461697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:32.462154 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:32.462580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:32.590085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:32.598120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:32.599647 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:32.600808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-64f6e3f0-3c24-4e93-9a07-eb7613d5fd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.151968 Aug 24 09:32:32.601901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 247/488] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:32.654124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:32.654746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:32.661093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:32.661587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:32.662032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:32.662731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:32.663191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:32.664145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:32.793789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:32.801246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8aea3b66-45e2-4efe-baa5-36acedff0854 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.150922 Aug 24 09:32:32.801798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 242/489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:32 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:33.623992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:33.624606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:33.630884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:33.631357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:33.631820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:33.632501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:33.632944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:33.633368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:33.764048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:33.772074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:33.773679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:33.775375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fd7a46f3-ff2a-407c-b046-d76bdac1ae81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155187 Aug 24 09:32:33.775968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 248/490] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:33.822056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:33.822664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:33.828531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:33.829015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:33.829448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:33.830127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:33.830576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:33.830996 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:33.959413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:33.967224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-84e48380-4688-47e9-abb7-0eecd8294064 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.148938 Aug 24 09:32:33.967800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 243/491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:33 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:34.800074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:34.800677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:34.807439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:34.807962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:34.808410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:34.809121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:34.809636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:34.810063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:34.938516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:34.947117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:34.948668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:34.949825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-453e976b-4380-4ade-b59e-38d06b6d9a40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.153697 Aug 24 09:32:34.950379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 249/492] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:34 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:34.988352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:34.988965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:34.995557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:34.996087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:34.996530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:34.997221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:34.997674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:34.998127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:35.127409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:35.135006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-78eaee88-043b-4b82-a516-25ad5fc1aaea tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.150562 Aug 24 09:32:35.135574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 244/493] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:34 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:35.972144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:35.972757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:35.979240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:35.979760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:35.980196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:35.980876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:35.981329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:35.981753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:36.121131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:36.121131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:36.122101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:36.123284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9817f0a9-bda1-4573-a563-b39ba465a31a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155002 Aug 24 09:32:36.123869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 250/494] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:35 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:36.155415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:36.156002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:36.161829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:36.162336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:36.162765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:36.163442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:36.163923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:36.164341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:36.290767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:36.298422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5e3a70b0-362e-41e7-ab2d-c206d6681d7b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.146932 Aug 24 09:32:36.298985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 245/495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:36 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:37.146227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:37.146895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:37.154106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:37.154589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:37.155028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:37.155758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:37.156214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:37.156641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:37.284971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:37.293231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:37.294766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:37.295959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5bbfa193-7fa1-451c-86dc-bd1e4272fc8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.153539 Aug 24 09:32:37.296509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 251/496] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:37 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:37.318367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:37.318985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:37.325453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:37.325939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:37.326472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:37.327206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:37.327803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:37.328241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:37.453411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:37.460938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8b086024-d86b-47a7-8b3d-b111979eb9f7 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.146423 Aug 24 09:32:37.461766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 246/497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:37 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:38.318033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:38.318616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:38.324912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:38.325389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:38.325834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:38.326523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:38.326976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:38.327400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:38.466904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:38.466904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:38.467166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:38.467166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f66426cd-c33b-4a7f-81cd-74b15e78c2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.149472 Aug 24 09:32:38.467166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 252/498] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:38 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:38.482721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:38.483445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:38.489430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:38.489989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:38.490466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:38.491125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:38.491574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:38.492018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:38.506893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:38.622043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:38.629647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-56c70941-ccf1-4732-b532-be7a66308fff tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.150728 Aug 24 09:32:38.630204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 247/499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:38 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:39.487053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:39.487692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:39.494811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:39.495290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:39.495762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:39.496455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:39.496908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:39.497337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:39.626574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:39.635682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:39.637193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:39.638346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5a7e5bd2-0156-4e5a-9ceb-a52c53abacd1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155200 Aug 24 09:32:39.638901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 253/500] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:39.650669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:39.651341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:39.657373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:39.657847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:39.658278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:39.658956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:39.659405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:39.659857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:39.785139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:39.793291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1839786c-6f67-46b9-ad0f-c1e7a538ffc5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.147022 Aug 24 09:32:39.793853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 248/501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:39 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:40.661220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:40.661793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:40.668804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:40.669289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:40.669732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:40.670424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:40.670884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:40.671311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:40.796146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:40.804130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:40.805644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:40.806806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b53019de-e2a7-4462-b8b7-e6138968db0d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.149614 Aug 24 09:32:40.807369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 254/502] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:40 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:40.814115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:40.824872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:40.824872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:40.824872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:40.824872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:40.825218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:40.825218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:40.825218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:40.952820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:40.960475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9b4ec775-6b5c-4e8f-832a-fd91920a574e tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.150160 Aug 24 09:32:40.961038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 249/503] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:40 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:41.846324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:41.846932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:41.853998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:41.854478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:41.854915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:41.855624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:41.856083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:41.856510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:41.982711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:41.983392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:41.985939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:41.989294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:41.989857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:41.990361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:41.991064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:41.991516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:41.991964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:41.994000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:41.995507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:41.996687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-04857139-36df-49c7-8cd7-7bca3fcecf5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.154280 Aug 24 09:32:41.997237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 255/504] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:41 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:42.119490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:42.126976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cd72b753-7cc8-4216-b3a5-e032af025537 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.148175 Aug 24 09:32:42.127531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 250/505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:41 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:43.018999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:43.019637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:43.026067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:43.026544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:43.026982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:43.027862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:43.028315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:43.028740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:43.146786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:43.147446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:43.153872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:43.154354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:43.154790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:43.155677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:43.155956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:43.156382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:43.158006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:43.166733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:43.168347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:43.169502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ce915e5-0365-42a0-b5f2-8a5ea84257b8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.154399 Aug 24 09:32:43.170042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 256/506] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:43.283220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:43.292604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ec778923-f3a5-446e-bd3b-7095b665ab33 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.149530 Aug 24 09:32:43.293197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 251/507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:43 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:44.192384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:44.192994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:44.199321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:44.199836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:44.200269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:44.200945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:44.201390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:44.201808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:44.313878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:44.314492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:44.320386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:44.320868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:44.321305 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:44.322003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:44.322457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:44.322882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:44.329596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:44.338609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:44.340174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:44.341359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2a9ec249-a43f-454e-b9f9-f71d2df617ce tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.152868 Aug 24 09:32:44.341919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 257/508] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:44 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:44.456436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:44.464859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b7d6bb9d-1a33-4aca-aaa9-ad99a9bcaa65 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.154789 Aug 24 09:32:44.465413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 252/509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:44 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:45.365227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:45.365830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:45.372305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:45.372780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:45.373236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:45.373916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:45.374360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:45.374778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:45.486016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:45.486974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:45.493475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:45.494199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:45.494709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:45.495411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:45.495899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:45.496329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:45.508995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:45.517801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:45.522337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:45.523693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b7c9b673-2e4b-4e50-b16b-8954e0430a1f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.162385 Aug 24 09:32:45.529336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 258/510] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:45.625352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:45.632910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-96104a46-14eb-4b0e-abf7-521dfc9c48a3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.150751 Aug 24 09:32:45.633523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 253/511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:45 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:46.546147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:46.546759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:46.553377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:46.553855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:46.554288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:46.554998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:46.556011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:46.556437 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:46.654057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:46.655504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:46.661538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:46.662024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:46.662457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:46.663153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:46.663621 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:46.664253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:46.693375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:46.694521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:46.696812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:46.698003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-632cda82-c6e6-4a56-88e9-ede8cced562f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.155795 Aug 24 09:32:46.698756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 259/512] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:46.802481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:46.811755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7a9f3d59-5e52-4e86-930b-26550097c226 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.161279 Aug 24 09:32:46.812323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 254/513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:46 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:47.721162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:47.721780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:47.728234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:47.728719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:47.729159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:47.729849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:47.730304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:47.730733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:47.745253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:47.832920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:47.833535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:47.840422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:47.841061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:47.841508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:47.842215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:47.842674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:47.843105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:47.864395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:47.873057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:47.874570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:47.875802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d2ff6631-11a0-4a12-bc23-320326dd1cd5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.158517 Aug 24 09:32:47.876369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 260/514] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:47 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:47.969017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:47.976549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e4aad9e3-3fe4-4638-a906-70856b18cad4 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.147542 Aug 24 09:32:47.977109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 255/515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:47 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:48.898670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:48.899270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:48.905605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:48.906077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:48.906535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:48.907211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:48.907678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:48.908101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:48.997722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:48.998338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:49.004275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:49.004765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:49.005205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:49.005915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:49.006373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:49.006806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:49.037074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:49.045809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:49.047310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:49.048503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1dd4ff3e-ea17-429b-a419-b3d29fa74759 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.153683 Aug 24 09:32:49.049059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 261/516] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:48 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:49.137114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:49.145041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dfbf2aca-7601-4cae-a2dd-bac9703024f2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.151680 Aug 24 09:32:49.145609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 256/517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:48 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:50.071212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:50.071862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:50.078870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:50.079353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:50.079832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:50.080526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:50.080983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:50.081413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:50.166163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:50.166787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:50.172779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:50.173373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:50.173812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:50.174495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:50.174944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:50.175363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:50.307231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:50.309693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:50.315335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-94b7d68c-1ad1-4ef0-a129-a5ab05729042 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.152999 Aug 24 09:32:50.316033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 257/518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:50 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:50.318068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:50.319638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:50.320839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-de697f21-09d6-4c6b-8f0f-cb6c3ce38362 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.253521 Aug 24 09:32:50.321415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 262/519] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:50 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:51.336324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:51.337210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:51.343389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:51.343866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:51.344041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:51.344144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:51.344523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:51.345224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:51.345690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:51.346119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:51.350238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:51.350709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:51.351151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:51.351865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:51.352311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:51.352730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:51.486208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:51.494291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:51.495824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:51.496967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-22ec747f-745b-4358-bce3-5d13bcdde545 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.157370 Aug 24 09:32:51.497516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 263/520] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:51 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:32:51.531183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:51.538836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9521e9e9-4ad1-452d-a3ed-e63840cefbef tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.206429 Aug 24 09:32:51.539402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 258/521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:51 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:52.520204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:52.520924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:52.527380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:52.528066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:52.528509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:52.529202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:52.529652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:52.530076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:52.560277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:52.560907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:52.567094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:52.567667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:52.568407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:52.568959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:52.569416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:52.569839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:52.662719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:52.671103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:52.672865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:52.674211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e084ad22-46f9-4513-9c15-a709d1e9ce4a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.158090 Aug 24 09:32:52.674773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 264/522] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:52.703492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:52.710973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0e630df0-9da7-48ad-8dd7-57f22428d0d3 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.155118 Aug 24 09:32:52.711813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 259/523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:52 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:53.696738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:53.697857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:53.704252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:53.704733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:53.705166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:53.705879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:53.706331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:53.706756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:53.732007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:53.732622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:53.738563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:53.739048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:53.739486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:53.740201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:53.740657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:53.741084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:53.838075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:53.846519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:53.849405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:53.850582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-df815fd0-3f7a-4fe3-acb6-f221099ab7b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.157855 Aug 24 09:32:53.851157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 265/524] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:53 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:32:53.872372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:53.880267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3019de39-02a3-4814-8ff1-48c338e73810 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.151957 Aug 24 09:32:53.891760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 260/525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:53 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:54.874435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:54.875045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:54.881702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:54.887548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:54.887548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:54.887548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:54.887548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:54.888079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:54.902203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:54.902832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:54.908773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:54.909258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:54.909916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:54.910618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:54.911079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:54.911516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:55.027104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:55.043879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:55.045530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:55.046769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-99359516-66d7-4f4f-8b1e-c0a0d22fdd83 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.177635 Aug 24 09:32:55.047532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 266/526] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:55.062028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:55.070023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f5270d58-2934-4b62-8198-354b4573939a tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.171665 Aug 24 09:32:55.070559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 261/527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:54 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:56.070288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:56.070955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:56.078570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:56.079044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:56.079479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:56.080204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:56.080751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:56.082036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:56.093470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:56.094101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:56.104303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:56.106787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:56.107252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:56.108028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:56.108504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:56.108940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:56.230946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:56.240032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:56.241524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:56.242698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1213c6e2-9284-4578-b773-cad4ace401b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1725 microversion: 2.20 time: 0.176405 Aug 24 09:32:56.243265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 267/528] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:32:56.254716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:56.264155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ca5f8842-a1a0-488b-b55e-3ea6cc0ae733 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.175145 Aug 24 09:32:56.264731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 262/529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:56 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:57.266625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:57.267239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:57.273634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:57.274109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:57.274537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:57.275810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:57.276258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:57.276677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:57.286247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:57.286959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:57.292865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:57.293344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:57.293777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:57.294510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:57.294910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:57.295331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:57.424020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:57.432004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fd315d2c-253e-421f-9786-ed838a5acad2 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.149393 Aug 24 09:32:57.438860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:57.445401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 263/530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:57 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:32:57.451362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:57.452898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:57.454067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e458763-7b8c-48aa-af3d-4af28a73582b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1746 microversion: 2.20 time: 0.191549 Aug 24 09:32:57.454749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 268/531] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:57 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1746 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:58.453282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:58.453900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:58.459818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:58.460307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:58.460747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:58.461699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:58.462160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:58.462614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:58.465154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:58.477660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:58.483549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:58.485068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:58.485555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:58.485993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:58.486699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:58.487148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:58.487575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:58.600978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:58.609199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f7588dc2-9de9-4b86-b8eb-8905f9437826 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.159792 Aug 24 09:32:58.609945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 264/532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:58 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:32:58.624344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:58.632595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:58.634149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:58.635972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b3f7dfa5-8cbb-4778-829c-558db613b2a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1746 microversion: 2.20 time: 0.162154 Aug 24 09:32:58.636527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 269/533] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:32:59.262602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1e6697f8-43d4-45f1-adcc-51bebfbdf107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: .version_select at 0x7fa9180ec0d0>, body: {"keypair": {"name": "tempest-keypair-1019154508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVAmHPkKA/3n0RHMzE0QPLFZ040WvF4PRxuPUxNnPb3r++5gvhE+/K/rEcF8YVPE+ni/Tdyn+7PG5/sDsPC/hPiu0BoqnsQAFHjjInxYO9OQDmgonelKwZZ+xXMelqwHg=="}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:32:59.278729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-1e6697f8-43d4-45f1-adcc-51bebfbdf107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:32:59.282515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-1e6697f8-43d4-45f1-adcc-51bebfbdf107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:32:59.344813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1e6697f8-43d4-45f1-adcc-51bebfbdf107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.086087 Aug 24 09:32:59.345407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 265/534] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 09:32:59 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:32:59.630539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:59.631166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:59.639402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:32:59.646599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:59.646599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:59.646599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:59.646599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:59.646990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:59.646990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:59.661401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:32:59.662727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:32:59.673932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:59.674717 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:59.676103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:59.677317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:32:59.678149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:32:59.679134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:32:59.859914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:59.870196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:59.870392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:59.871979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:32:59.873241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5b6b76e1-30aa-4ea5-82b4-5f2eca0aa4fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1746 microversion: 2.20 time: 0.218881 Aug 24 09:32:59.874162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 266/535] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:32:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1746 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:32:59.878986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-15171bc4-fe91-44b8-a58f-94411a21bc26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1372 microversion: 2.1 time: 0.252584 Aug 24 09:32:59.880035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 270/536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:32:59 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1372 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:00.896752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:00.897260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:00.899371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:00.901090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:00.901711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:00.905069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:00.905555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:00.905990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:00.906683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:00.907301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:00.907769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:00.910165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:00.910900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:00.911341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:00.912291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:00.912754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:00.913400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:01.047276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:01.056138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:01.057636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:01.058797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cf2d7f18-d4ab-4c25-bac8-b3573e0732dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1746 microversion: 2.20 time: 0.166089 Aug 24 09:33:01.059353 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 267/537] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1746 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:01.125760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:01.133321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-caf238cd-5039-4804-9bb0-8fc8f963a1a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1566 microversion: 2.1 time: 0.236636 Aug 24 09:33:01.133886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 271/538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:00 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1566 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:33:01.156771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:01.156771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:01.161788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:01.162644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:01.163084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:01.163990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:01.164610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:01.165061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:01.246638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-59c9314b-29bc-42b6-812c-131ebcbd74e0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095533 Aug 24 09:33:01.247234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 268/539] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Aug 24 09:33:01 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:33:01.590854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-fedc7708-8dfd-4f95-bf29-cbcc15326296 req-d54852dc-85bc-41e2-8de1-c5758f5d41c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e093c82-b762-45aa-840b-26b6b982f8bc", "name": "network-vif-plugged", "status": "completed", "tag": "c90b8067-74c1-43cb-b490-fe8f8d77018f"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:01.604387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-fedc7708-8dfd-4f95-bf29-cbcc15326296 req-d54852dc-85bc-41e2-8de1-c5758f5d41c8 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:01.604870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-fedc7708-8dfd-4f95-bf29-cbcc15326296 req-d54852dc-85bc-41e2-8de1-c5758f5d41c8 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:01.605301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-fedc7708-8dfd-4f95-bf29-cbcc15326296 req-d54852dc-85bc-41e2-8de1-c5758f5d41c8 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:01.616940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-fedc7708-8dfd-4f95-bf29-cbcc15326296 req-d54852dc-85bc-41e2-8de1-c5758f5d41c8 service nova] Creating event network-vif-plugged:c90b8067-74c1-43cb-b490-fe8f8d77018f for instance 9e093c82-b762-45aa-840b-26b6b982f8bc on hv-cinder-85032 Aug 24 09:33:01.622836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-fedc7708-8dfd-4f95-bf29-cbcc15326296 req-d54852dc-85bc-41e2-8de1-c5758f5d41c8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 Aug 24 09:33:01.623441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 272/540] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:33:02.081879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:02.082490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:02.089392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:02.090074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:02.090704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:02.091405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:02.091888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:02.092312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:02.286753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2087637136", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d78a8de-2c64-4044-abe6-4ba1346bd716"}], "security_groups": [{"name": "tempest-securitygroup--915837270"}], "key_name": "tempest-keypair-1019154508", "user_data": "}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:02.316595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:02.324803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:02.327779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:02.328949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-07f40992-a408-4132-9a17-7f843d706374 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1746 microversion: 2.20 time: 0.251037 Aug 24 09:33:02.329490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 269/541] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1746 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:02.393741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-fa3c5602-9bd9-4e53-990b-9d2b43e2a2f2 req-e1d31d2c-d049-4bf7-bf38-fc9f8e59c061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e147f8-b859-4bd1-bb4e-568041201520", "tag": "f7a0b684-ee3d-4463-a53a-01d76f4dfaac"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:02.423521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-fa3c5602-9bd9-4e53-990b-9d2b43e2a2f2 req-e1d31d2c-d049-4bf7-bf38-fc9f8e59c061 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:02.424030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-fa3c5602-9bd9-4e53-990b-9d2b43e2a2f2 req-e1d31d2c-d049-4bf7-bf38-fc9f8e59c061 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:02.424457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-fa3c5602-9bd9-4e53-990b-9d2b43e2a2f2 req-e1d31d2c-d049-4bf7-bf38-fc9f8e59c061 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:02.455356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] validate_networks() for [('2d78a8de-2c64-4044-abe6-4ba1346bd716', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:33:02.462564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-fa3c5602-9bd9-4e53-990b-9d2b43e2a2f2 req-e1d31d2c-d049-4bf7-bf38-fc9f8e59c061 service nova] Creating event network-changed:f7a0b684-ee3d-4463-a53a-01d76f4dfaac for instance f2e147f8-b859-4bd1-bb4e-568041201520 on hv-cinder-85032 Aug 24 09:33:02.469721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-fa3c5602-9bd9-4e53-990b-9d2b43e2a2f2 req-e1d31d2c-d049-4bf7-bf38-fc9f8e59c061 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079089 Aug 24 09:33:02.470727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 270/542] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:33:03.013301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:33:03.013768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:33:03.014481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:33:03.014896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:33:03.015306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:33:03.024419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:03.025416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:03.025849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:03.026624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:03.027076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:03.027719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:03.045576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:33:03.049815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:33:03.062192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:33:03.064615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:33:03.218645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [11fd08d5-a0f1-402d-bdab-c0bee1b5d10e] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 09:33:03.351962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:03.352674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:03.359124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:03.359640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:03.360087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:03.360796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:03.361253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:03.361680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:03.536822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:03.545062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:03.546646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:03.547791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2f0d82da-eb0c-4fe0-b719-b8a76d0cc3c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1746 microversion: 2.20 time: 0.200113 Aug 24 09:33:03.548352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 271/543] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:03 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1746 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:33:04.226894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [11fd08d5-a0f1-402d-bdab-c0bee1b5d10e] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 51306. Aug 24 09:33:04.231652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6606174e-6a92-47e7-9265-4b953cda9703 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.950268 Aug 24 09:33:04.232309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 273/544] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:33:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 09:33:04.244547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-824dfd3d-304b-4bd1-881b-fe99ebf4ad80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:04.245156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-824dfd3d-304b-4bd1-881b-fe99ebf4ad80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:04.297134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-824dfd3d-304b-4bd1-881b-fe99ebf4ad80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:04.304197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-824dfd3d-304b-4bd1-881b-fe99ebf4ad80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1242 microversion: 2.1 time: 0.064705 Aug 24 09:33:04.304770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 272/545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:04 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:04.571597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:04.572421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:04.579962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:04.580210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:04.580650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:04.581346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:04.581799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:04.582351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:04.718694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:04.726984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:04.728535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:04.729761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a6b410a6-06d0-4956-b7d8-b7324f4bc258 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1746 microversion: 2.20 time: 0.162856 Aug 24 09:33:04.730307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 274/546] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:05.325650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:05.326858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:05.333707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:05.334262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:05.334741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:05.335475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:05.336102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:05.336833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:05.401499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:05.409853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-55b05b4e-3657-4e1d-bfeb-e56b4fbc5e84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1246 microversion: 2.1 time: 0.088540 Aug 24 09:33:05.410435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 273/547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:05 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:05.754355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:05.754965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:05.761418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:05.761984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:05.762385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:05.763068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:05.763512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:05.763969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:05.903940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:05.915969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:05.917799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:05.919464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9f603c52-f45b-4448-a950-532c3504771a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.168816 Aug 24 09:33:05.920607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 275/548] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:06.431389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:06.432071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:06.439928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:06.442458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:06.443828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:06.446375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:06.447104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:06.448688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:06.532365 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:06.543626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-36f2c569-3f02-4af8-ac9d-e17ba59a1b7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1302 microversion: 2.1 time: 0.115913 Aug 24 09:33:06.544562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 274/549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:06 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1302 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:07.097404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:07.098644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:07.108248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:07.109067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:07.109518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:07.110277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:07.110737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:07.111385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:07.384022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:07.392532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:07.394043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:07.395535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-87fc2d0f-c585-472c-b47f-184e5bcb94f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.456221 Aug 24 09:33:07.396663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 276/550] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:07.565694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:07.567066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:07.574431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:07.576697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:07.576697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:07.576697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:07.576697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:07.577097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:07.906404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:07.906404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-488c301d-8bb5-45ce-b3a9-90504b451caa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.281608 Aug 24 09:33:07.906404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 275/551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:07 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:33:08.422650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:08.423356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:08.430257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:08.431098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:08.432048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:08.433501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:08.434229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:08.434723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:08.703277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:08.712409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:08.713920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:08.715113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a05aa1cc-92d5-44f0-928a-59055e1a3721 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.297570 Aug 24 09:33:08.715936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 277/552] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:08 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:08.867255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:08.867255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:08.871668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:08.872165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:08.872608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:08.873388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:08.873855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:08.874288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:08.887928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-68a0704f-44e8-48ec-9fd0-3e13fdd656fc req-f16cccce-babb-452b-99aa-c0ca3e0f6cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2c3983-8b10-4ca8-b317-368b1ebeffb5", "tag": "471deb21-d81c-4019-8f2c-e159e47553f1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:08.898180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-68a0704f-44e8-48ec-9fd0-3e13fdd656fc req-f16cccce-babb-452b-99aa-c0ca3e0f6cb9 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:08.898667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-68a0704f-44e8-48ec-9fd0-3e13fdd656fc req-f16cccce-babb-452b-99aa-c0ca3e0f6cb9 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:08.899097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-68a0704f-44e8-48ec-9fd0-3e13fdd656fc req-f16cccce-babb-452b-99aa-c0ca3e0f6cb9 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:08.910584 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-68a0704f-44e8-48ec-9fd0-3e13fdd656fc req-f16cccce-babb-452b-99aa-c0ca3e0f6cb9 service nova] Creating event network-changed:471deb21-d81c-4019-8f2c-e159e47553f1 for instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 on hv-cinder-85032 Aug 24 09:33:08.915886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-68a0704f-44e8-48ec-9fd0-3e13fdd656fc req-f16cccce-babb-452b-99aa-c0ca3e0f6cb9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040045 Aug 24 09:33:08.916969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 278/553] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:33:09.065572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:09.079670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8fb7de3f-3a04-4d23-a70a-52065d737334 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.219141 Aug 24 09:33:09.092847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 276/554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:08 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:09.739212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:09.740031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:09.747855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:09.748678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:09.749460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:09.750369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:09.751036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:09.751834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:09.755603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:09.993135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:10.020942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:10.022857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:10.024927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c0040d39-8b05-414f-b77b-d070d0e30ebf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.290403 Aug 24 09:33:10.027200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 279/555] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:09 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:10.103346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:10.104038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:10.113754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:10.114276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:10.114718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:10.115432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:10.115972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:10.116402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:10.294816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:10.320808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e93d78ef-789c-4bf4-bc86-72435718e016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.222026 Aug 24 09:33:10.341787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 277/556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:10 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:11.056150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:11.057876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:11.069200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:11.075241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:11.081947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:11.081947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:11.081947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:11.081947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:11.295460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:11.308228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:11.329282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:11.329282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-35adddc1-d3a0-400f-9f8d-76ee80e1924d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.263139 Aug 24 09:33:11.329282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 280/557] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:11 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:11.348853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:11.350455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:11.357859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:11.358663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:11.359387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:11.360605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:11.361247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:11.361855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:11.576852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:11.587464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cd4f2884-100e-4991-8f63-c1d9892763a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.242530 Aug 24 09:33:11.592661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 278/558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:11 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:12.337076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:12.338901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:12.345168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:12.345653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:12.346092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:12.346798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:12.347244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:12.347768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:12.504286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:12.519076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:12.522502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:12.523747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ac11350-d95e-416a-b754-f4958e2196f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.190827 Aug 24 09:33:12.524604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 281/559] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:12.614398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:12.615908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:12.622724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:12.623521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:12.623981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:12.624942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:12.625629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:12.626133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:12.767324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:12.777325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a49183a5-793b-4719-a668-a21e1acdd7bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.166730 Aug 24 09:33:12.778310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 279/560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:12 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:13.558036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:13.560959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:13.567637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:13.571363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:13.582897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:13.585971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:13.587155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:13.588607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:13.589852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:13.591557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:13.801133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:13.806104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:13.806754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:13.823143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:13.824698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:13.825371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:13.826199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:13.829359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:13.831635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:13.832247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:13.833065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:13.835841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0a805a79-c0c5-462b-87ce-d6e1b0f834ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.286042 Aug 24 09:33:13.841615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 282/561] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:13.993392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:14.001704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-322c19d7-f602-45b8-a542-f0d591872b31 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.206830 Aug 24 09:33:14.007794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 280/562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:13 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:14.867184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:14.868518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:14.876292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:14.877898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:14.877898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:14.878106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:14.878464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:14.878895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:15.023263 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:15.023949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:15.025823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:15.026139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:15.031041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:15.031533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:15.032013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:15.032720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:15.033183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:15.033614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:15.035067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:15.037549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:15.038733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-11b10fae-1b4e-426a-ad46-18cd74d0296c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.176113 Aug 24 09:33:15.039301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 283/563] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:15.160891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:15.169409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8f15d76d-b59a-40a7-baaa-700f99509b74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.150059 Aug 24 09:33:15.169995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 281/564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:15 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:33:16.065914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:16.066527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:16.073659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:16.074371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:16.074803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:16.075499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:16.075976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:16.076399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:16.190770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:16.191387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:16.201509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:16.202060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:16.202419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:16.203251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:16.203776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:16.204213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:16.292875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:16.303364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:16.305162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:16.307429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d6c4786e-a78e-4aff-ba55-e69d55e802fc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.244524 Aug 24 09:33:16.319607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 284/565] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:16 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:16.319607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-753e747f-9487-4e3a-95f2-254299b53a40 req-519c5314-c36b-4c87-a016-73dc4b1bac1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2c3983-8b10-4ca8-b317-368b1ebeffb5", "name": "network-vif-plugged", "status": "completed", "tag": "471deb21-d81c-4019-8f2c-e159e47553f1"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:16.329458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-753e747f-9487-4e3a-95f2-254299b53a40 req-519c5314-c36b-4c87-a016-73dc4b1bac1b service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:16.329458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-753e747f-9487-4e3a-95f2-254299b53a40 req-519c5314-c36b-4c87-a016-73dc4b1bac1b service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:16.329458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-753e747f-9487-4e3a-95f2-254299b53a40 req-519c5314-c36b-4c87-a016-73dc4b1bac1b service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:16.339372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-753e747f-9487-4e3a-95f2-254299b53a40 req-519c5314-c36b-4c87-a016-73dc4b1bac1b service nova] Creating event network-vif-plugged:471deb21-d81c-4019-8f2c-e159e47553f1 for instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 on hv-cinder-85032 Aug 24 09:33:16.345564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-753e747f-9487-4e3a-95f2-254299b53a40 req-519c5314-c36b-4c87-a016-73dc4b1bac1b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035140 Aug 24 09:33:16.345564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 285/566] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:33:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:33:16.434580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:16.445020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ece4becf-937f-4277-934f-e6b7fc91384b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.257927 Aug 24 09:33:16.451827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 282/567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:16 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:17.331281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:17.332068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:17.338918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:17.339393 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:17.339860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:17.340546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:17.340995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:17.341414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:17.467141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:17.467778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:17.471399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:17.473616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:17.474089 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:17.474519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:17.475207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:17.475678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:17.476099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:17.479994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:17.481490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:17.482758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-660e4d35-9026-40dd-9370-0960381e8f9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.156271 Aug 24 09:33:17.483312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 286/568] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:17 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:17.604425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:17.606582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:17.612915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2efcfab3-767d-4e92-81b7-3e95c56ba950 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.150223 Aug 24 09:33:17.613505 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 283/569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:17 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:33:18.505636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:18.506224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:18.512494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:18.512973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:18.513400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:18.514081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:18.514527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:18.516902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:18.633859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:18.640224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:18.640620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:18.641114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:18.641555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:18.642269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:18.642727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:18.643237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:18.651327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:18.659312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:18.664327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:18.664327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-870a1014-7fb3-4eec-8629-9e62eb7baa37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1741 microversion: 2.20 time: 0.160284 Aug 24 09:33:18.664327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 287/570] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1741 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:18.774437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:18.782569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-652243a6-8eba-45d9-850f-071ea8aa2fcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.153018 Aug 24 09:33:18.783128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 284/571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:18 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:33:19.685577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:19.686193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:19.692614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:19.693102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:19.693539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:19.694236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:19.694695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:19.695122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:19.803526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:19.804160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:19.810682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:19.811312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:19.811629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:19.812324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:19.812775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:19.813194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:19.842772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:19.851456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:19.857368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:19.857368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-120778d2-2ad2-4800-96e4-e56bc339da04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1723 microversion: 2.20 time: 0.173649 Aug 24 09:33:19.857368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 288/572] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:19.942776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:19.951326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1d2fe8a4-be36-4aea-acf6-6a90359a2a44 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1367 microversion: 2.1 time: 0.151536 Aug 24 09:33:19.951934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 285/573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:19 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:20.878258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:20.878860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:20.885181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:20.885663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:20.886095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:20.886833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:20.887236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:20.887685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:20.972614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:20.973231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:20.979556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:20.980065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:20.980680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:20.981546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:20.982152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:20.983059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:21.121926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:21.129933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-003854a7-4210-45e4-8854-914cfc3928da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1557 microversion: 2.1 time: 0.161063 Aug 24 09:33:21.130514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 286/574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:33:20 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:33:21.150818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:21.151223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:21.157273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:21.157751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:21.158184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:21.158881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:21.159332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:21.159802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:21.237270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fa423608-3705-42c5-8b42-c8430bb458ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090871 Aug 24 09:33:21.237997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 287/575] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Aug 24 09:33:21 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:33:21.304542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:21.314099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:21.315665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:21.316843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-75b95536-f85f-4c41-946b-edd85d6de490 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1723 microversion: 2.20 time: 0.442473 Aug 24 09:33:21.317600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 289/576] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1723 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:22.067109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-9303845b-7b4d-4da4-9a27-00394f6db040 req-ecd304de-6eaf-4b6c-903f-bf3339e54aec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e093c82-b762-45aa-840b-26b6b982f8bc", "name": "network-vif-unplugged", "status": "completed", "tag": "c90b8067-74c1-43cb-b490-fe8f8d77018f"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:22.078872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-9303845b-7b4d-4da4-9a27-00394f6db040 req-ecd304de-6eaf-4b6c-903f-bf3339e54aec service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:22.079379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-9303845b-7b4d-4da4-9a27-00394f6db040 req-ecd304de-6eaf-4b6c-903f-bf3339e54aec service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:22.080011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-9303845b-7b4d-4da4-9a27-00394f6db040 req-ecd304de-6eaf-4b6c-903f-bf3339e54aec service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:22.093979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-9303845b-7b4d-4da4-9a27-00394f6db040 req-ecd304de-6eaf-4b6c-903f-bf3339e54aec service nova] Creating event network-vif-unplugged:c90b8067-74c1-43cb-b490-fe8f8d77018f for instance 9e093c82-b762-45aa-840b-26b6b982f8bc on hv-cinder-85032 Aug 24 09:33:22.099826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-9303845b-7b4d-4da4-9a27-00394f6db040 req-ecd304de-6eaf-4b6c-903f-bf3339e54aec service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038668 Aug 24 09:33:22.103449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 288/577] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:33:22.340036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:22.340708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:22.347172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:22.347690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:22.348128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:22.348822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:22.349278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:22.349745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:22.436438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-ddcc8c94-2ec8-4a5b-8234-e4889054b80a req-b161b039-e02d-49e1-9706-e3dd304ec299 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e2c3983-8b10-4ca8-b317-368b1ebeffb5", "tag": "471deb21-d81c-4019-8f2c-e159e47553f1"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:22.446275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-ddcc8c94-2ec8-4a5b-8234-e4889054b80a req-b161b039-e02d-49e1-9706-e3dd304ec299 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:22.447557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-ddcc8c94-2ec8-4a5b-8234-e4889054b80a req-b161b039-e02d-49e1-9706-e3dd304ec299 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:22.448031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-ddcc8c94-2ec8-4a5b-8234-e4889054b80a req-b161b039-e02d-49e1-9706-e3dd304ec299 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:22.458795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-ddcc8c94-2ec8-4a5b-8234-e4889054b80a req-b161b039-e02d-49e1-9706-e3dd304ec299 service nova] Creating event network-changed:471deb21-d81c-4019-8f2c-e159e47553f1 for instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 on hv-cinder-85032 Aug 24 09:33:22.464020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-ddcc8c94-2ec8-4a5b-8234-e4889054b80a req-b161b039-e02d-49e1-9706-e3dd304ec299 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038337 Aug 24 09:33:22.464539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 289/578] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:33:22.491681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:22.500302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:22.501802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:22.502954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ec706e7b-c3e8-40cb-a454-a268d4b2ee81 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1723 microversion: 2.20 time: 0.167147 Aug 24 09:33:22.503503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 290/579] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:23.527233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:23.527971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:23.534711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:23.535203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:23.535693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:23.536652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:23.537114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:23.537546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:23.677357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:23.684756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:23.686268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:23.687469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-33f27b73-e59d-4e32-a55e-133efcd7bcac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1723 microversion: 2.20 time: 0.165491 Aug 24 09:33:23.688094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 290/580] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:24.710511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:24.711053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:24.717945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:24.718432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:24.718869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:24.719560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:24.720042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:24.720467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:24.850599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:24.859003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:24.860515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:24.861701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5a3feb5c-d97e-491e-9590-bccc4a218f53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1726 microversion: 2.20 time: 0.155321 Aug 24 09:33:24.862248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 291/581] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:24 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:24.883604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e5011d7-58af-4e64-aea9-c8b9db6185a6"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:24.886448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:24.892338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:24.892817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:24.893251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:24.893963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:24.894409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:24.894823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:25.889262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ed074dd4-59a5-4ad5-b204-ad3208b2e607 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "POST /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.009480 Aug 24 09:33:25.889877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 291/582] 10.222.0.16 () {62 vars in 1364 bytes} [Wed Aug 24 09:33:24 2022] POST /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-volume_attachments => generated 188 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:33:26.014592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:33:26.015195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:26.021580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:26.022065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:26.022504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:26.023200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:26.023701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:26.024132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:26.121445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121142) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 24 09:33:26.379291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-49ba1fcc-7d8d-4c89-8b42-0218cc5b7791 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "POST /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/action" status: 202 len: 0 microversion: 2.20 time: 0.368495 Aug 24 09:33:26.379941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 292/583] 10.222.0.16 () {62 vars in 1319 bytes} [Wed Aug 24 09:33:26 2022] POST /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:33:26.388828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:26.389731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:26.396005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:26.396533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:26.396968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:26.397658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:26.398108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:26.398534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:26.529675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:26.538887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:26.541254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:26.542645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f6bb0500-9d8e-4bb2-8981-9bcfe62bdf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1752 microversion: 2.20 time: 0.158382 Aug 24 09:33:26.543453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 292/584] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:27.568465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:27.569096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:27.575501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:27.576020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:27.576457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:27.577186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:27.577638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:27.578064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:27.710410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:27.719924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:27.721424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:27.722579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1094ccb-7db7-44d3-ba6d-7d956453d2f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1752 microversion: 2.20 time: 0.160274 Aug 24 09:33:27.723135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 293/585] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:28.750359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:28.750998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:28.756892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:28.757417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:28.757848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:28.758523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:28.758971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:28.759438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:28.887477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:28.895884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:28.897374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:28.898513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1b9e627d-efe6-4013-91de-cdc7ea06a819 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152118 Aug 24 09:33:28.899069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 293/586] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:28 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:29.921809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:29.922425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:29.924887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:29.929549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:29.930034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:29.930471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:29.931728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:29.932192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:29.932621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:30.058809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:30.067462 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:30.068989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:30.073023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b90874f1-ab19-4469-959f-bc5aa3c7b5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152331 Aug 24 09:33:30.073023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 294/587] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:29 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:31.093180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:31.093784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:31.095742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=56 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:31.100509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:31.101018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:31.101444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:31.102174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:31.102627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:31.103571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:31.229549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:31.238075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:31.239615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:31.240767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-18ca87dd-cd55-417b-a3fe-0c21caa36868 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151502 Aug 24 09:33:31.241322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 294/588] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:32.263435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:32.264070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:32.270314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:32.270793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:32.271228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:32.272010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:32.272458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:32.272889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:32.290307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:32.405150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:32.413609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:32.415089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:32.416914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-11d011bd-e727-4da8-bffe-e505bb3be04d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157307 Aug 24 09:33:32.417461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 295/589] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:33.439268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:33.439939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:33.445884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:33.446369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:33.446806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:33.447497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:33.447980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:33.448412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:33.577109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:33.585739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:33.588186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:33.589257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6e791b71-7e0e-4f9e-80d4-fc913ad31930 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153919 Aug 24 09:33:33.589820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 295/590] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:34.611822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:34.612356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:34.618598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:34.619075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:34.619507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:34.620731 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:34.621183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:34.621604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:34.752333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:34.761537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:34.763023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:34.764203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-275677c0-9577-44ed-bc2b-6b357fbae0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.156403 Aug 24 09:33:34.764743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 296/591] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:34 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:35.786241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:35.786853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:35.793993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:35.794474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:35.794908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:35.795616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:35.796069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:35.796493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:35.924556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:35.933049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:35.934970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:35.936162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-962e5e3b-3c36-463a-a35c-395e730be458 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153835 Aug 24 09:33:35.936722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 296/592] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:35 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:36.958258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:36.958857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:36.965186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:36.965663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:36.966095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:36.966774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:36.967219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:36.967656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:37.094617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:37.103249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:37.104785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:37.106451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1d8dda7-913b-4f88-9d98-fbb36a5ddc80 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152128 Aug 24 09:33:37.107003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 297/593] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:36 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:38.130380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:38.130916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:38.137536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:38.138012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:38.138447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:38.139128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:38.139604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:38.140035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:38.267006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:38.275629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:38.277125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:38.278269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1fcf3a1f-f594-4dfc-ba49-340023b81977 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151918 Aug 24 09:33:38.280161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 297/594] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:38 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:33:39.300637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:39.301249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:39.307701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:39.308180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:39.308613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:39.309298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:39.309749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:39.310170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:39.439220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:39.447815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:39.449850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:39.451029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2ccd4f8b-abcc-4340-a6a1-05bde71ad918 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154352 Aug 24 09:33:39.451615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 298/595] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:40.473643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:40.474248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:40.480122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:40.481171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:40.481603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:40.482277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:40.482722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:40.483134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:40.609106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:40.617581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:40.619081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:40.620250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b71964e7-9153-4530-b59c-8fb0ee1331bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.150562 Aug 24 09:33:40.620800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 298/596] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:40 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:41.642263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:41.642875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:41.649312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:41.649793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:41.650234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:41.650926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:41.651380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:41.651839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:41.780986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:41.789805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:41.791303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:41.792518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1e418605-e612-4b10-b742-97f708b668df tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154164 Aug 24 09:33:41.793072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 299/597] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:41 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:42.815532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:42.816164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:42.821912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:42.822385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:42.822814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:42.823489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:42.823967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:42.825185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:42.839643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:33:42.950106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:42.958438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:42.959961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:42.961102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3422401d-0c9f-4c0d-bdae-1e7e928f5676 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.149638 Aug 24 09:33:42.961913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 299/598] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:42 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:43.985172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:43.985789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:43.992226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:43.992711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:43.993152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:43.993848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:43.994302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:43.994738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:44.124990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:44.134040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:44.135760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:44.136892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-482c1706-36b3-4946-b13d-d5f3591361bb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.156287 Aug 24 09:33:44.138136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 300/599] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:45.160657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:45.161205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:45.167296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:45.167817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:45.168897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:45.169447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:45.169902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:45.170325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:45.303500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:45.312110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:45.314202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:45.315352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7e1e833c-38b4-4d28-9cb7-123b3d3ef8f4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.159734 Aug 24 09:33:45.315936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 300/600] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:46.338491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:46.339096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:46.346290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:46.346767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:46.347200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:46.347905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:46.348355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:46.348773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:46.476312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:46.485579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:46.486997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:46.488185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5573b1a5-b1bf-48d5-9dfc-b0d6c7db5e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153840 Aug 24 09:33:46.488730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 301/601] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:47.510205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:47.510835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:47.516741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:47.517214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:47.517641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:47.518316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:47.518760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:47.519176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:47.644172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:47.652815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:47.654307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:47.655454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1177280f-7b11-4d2d-9d61-49e74ba516dc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.149133 Aug 24 09:33:47.656054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 301/602] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:47 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:48.678199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:48.678742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:48.685505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:48.685975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:48.686407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:48.687084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:48.687529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:48.687970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:48.816711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:48.826030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:48.827524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:48.828755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9ca49652-6024-4384-88b4-b7eca2ce70eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154459 Aug 24 09:33:48.829299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 302/603] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:48 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:49.851496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:49.852179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:49.858256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:49.858737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:49.859175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:49.859889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:49.860344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:49.860768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:49.988795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:49.997859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:49.999371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:50.000571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-19ab3aa3-2c03-4c9f-aca3-d89bc32e0641 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152940 Aug 24 09:33:50.001135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 302/604] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:49 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:51.024082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:51.024680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:51.031568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:51.032070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:51.032505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:51.033197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:51.033649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:51.034072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:51.164633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:51.180566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:51.182088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:51.183255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a37b0c0c-5401-4335-b5f6-26e52cea6403 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.163195 Aug 24 09:33:51.184615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 303/605] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:51 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:52.206303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:52.206947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:52.213032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:52.213513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:52.213948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:52.214628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:52.215669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:52.216099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:52.343676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:52.352143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:52.353634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:52.354817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8c0479bb-1595-4a12-8455-fa2c394a2124 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152424 Aug 24 09:33:52.355979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 303/606] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:53.378086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:53.379947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:53.385235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:53.385752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:53.386189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:53.386876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:53.387358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:53.387814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:53.514981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:53.523549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:53.525127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:53.526223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a3222f7d-7b56-49dc-9eb0-6b567d693e21 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152088 Aug 24 09:33:53.526790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 304/607] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:53 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:33:54.549305 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:54.549934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:54.555863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:54.556276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:54.556713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:54.557388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:54.557837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:54.558257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:54.685456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:54.694034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:54.695523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:54.696697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dd1f4980-e0be-4ab1-b5b9-172c5bef08e1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151264 Aug 24 09:33:54.697245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 304/608] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:55.719131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:55.719810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:55.726660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:55.726773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:55.730139 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:55.731389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:55.731889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:55.732326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:55.870741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:55.880411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:55.881828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:55.882996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b90cc02c-087c-41ed-a5ab-e35478bd6856 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.167726 Aug 24 09:33:55.883561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 305/609] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:55 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:56.904953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:56.905500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:56.911392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:56.911906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:56.912343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:56.913029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:56.913480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:56.913901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:57.041448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:57.050022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:57.051518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:57.052692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-33b40a31-5657-41e3-ad3c-8c010b08c9e9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151749 Aug 24 09:33:57.053245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 305/610] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:58.076578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:58.077191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:58.083823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:58.084310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:58.084752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:58.085442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:58.085897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:58.086585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:58.212020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:58.221100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:58.222608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:58.223803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c1d66a58-11f2-407c-a72e-69c44d8e8a53 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151645 Aug 24 09:33:58.224367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 306/611] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:33:59.246912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:33:59.247443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:33:59.253350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:59.253854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:59.254282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:59.254956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:33:59.255402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:33:59.255841 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:33:59.382450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:59.390881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:59.392397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:33:59.393547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4fed72bc-8aa3-4f29-a171-af1ef9fbbb9e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151147 Aug 24 09:33:59.394104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 306/612] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:33:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:00.415854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:00.416459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:00.419272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=26 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:00.423901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:00.427872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:00.427872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:00.427872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:00.427872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:00.428227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:00.552882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:00.561490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:00.562942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:00.564124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-79d528e4-d3b9-40f4-b440-4971e0d7491e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152177 Aug 24 09:34:00.564676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 307/613] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:01.586792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:01.587359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:01.589981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=26 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:01.594614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:01.599813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:01.599813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:01.599813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:01.599813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:01.600176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:01.729198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:01.737944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:01.739446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:01.740631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2861c5c1-5c87-4cd1-bbc8-c5e74646ecae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.158068 Aug 24 09:34:01.741453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 307/614] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:01 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:02.763926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:02.764537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:02.770871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:02.771355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:02.771820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:02.772517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:02.773024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:02.773417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:02.776055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=76 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:02.905744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:02.914199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:02.915712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:02.916848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1dda8130-04ba-4679-bf34-fff97f871ba3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157498 Aug 24 09:34:02.917406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 308/615] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:03.938826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:03.939433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:03.945378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:03.945856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:03.946290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:03.946978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:03.947429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:03.947887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:04.074850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:04.083398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:04.085031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:04.086169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1252d490-eb73-4886-92e4-29bed49834f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151324 Aug 24 09:34:04.087029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 308/616] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:03 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:05.108704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:05.109246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:05.115514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:05.116023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:05.116454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:05.117133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:05.117575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:05.117994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:05.244833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:05.253897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:05.255399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:05.256580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-648fc4e0-f2ac-4254-b330-157940dc8f19 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151934 Aug 24 09:34:05.257140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 309/617] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:06.279993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:06.280609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:06.286502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:06.286988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:06.287455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:06.288177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:06.288634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:06.289059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:06.414054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:06.422558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:06.424091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:06.425246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ba339fd7-21b6-4dfb-a23e-3f7b268d5d74 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.149759 Aug 24 09:34:06.425800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 309/618] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:07.447991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:07.448630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:07.454588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:07.455061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:07.455494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:07.456194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:07.456644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:07.457065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:07.585535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:07.594856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:07.596388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:07.597544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a2cff893-4841-4798-80de-11fc6bb7b5d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153448 Aug 24 09:34:07.598107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 310/619] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:07 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:08.619907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:08.621023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:08.626781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:08.627262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:08.632104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:08.632104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:08.632104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:08.632104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:08.758981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:08.768072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:08.769782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:08.770689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d288baa4-b3be-4ef4-a5b9-76de927791b7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154767 Aug 24 09:34:08.771243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 310/620] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:08 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:09.793501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:09.794100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:09.800517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:09.800991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:09.801422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:09.802102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:09.802547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:09.802966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:09.929228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:09.937708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:09.939182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:09.940356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a06e3d02-395a-4b62-99e5-4d2590ebc903 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151327 Aug 24 09:34:09.940925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 311/621] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:09 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:10.963615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:10.964829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:10.970674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:10.971157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:10.971613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:10.972317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:10.972769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:10.973222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:11.099049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:11.107733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:11.109233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:11.110424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dd99a915-f64c-43dd-a93f-4be2be7d046c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.150964 Aug 24 09:34:11.110973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 311/622] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:10 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:12.133354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:12.133966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:12.141027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:12.141495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:12.141972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:12.142666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:12.143091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:12.143519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:12.274920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:12.284043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:12.285546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:12.286779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-37dac989-e982-4095-a500-dbf3adf08ac9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157293 Aug 24 09:34:12.287337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 312/623] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:13.309182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:13.309845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:13.315800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:13.316366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:13.316840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:13.317494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:13.317947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:13.318369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:13.322286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=76 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:13.453813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:13.462382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:13.464386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:13.465520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9fe522b6-6b25-42d6-8d35-a52db95bf4b0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.160257 Aug 24 09:34:13.466067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 312/624] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:14.487526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:14.488170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:14.494490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:14.494971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:14.496102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:14.496798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:14.497256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:14.497679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:14.625849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:14.634418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:14.635948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:14.637107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-78a2a7f8-f9fe-4cf4-a2d4-dacc32301a6f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153413 Aug 24 09:34:14.637658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 313/625] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:15.659728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:15.660209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:15.666305 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:15.666797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:15.667852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:15.668556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:15.669291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:15.669520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:15.797495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:15.806076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:15.807600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:15.808762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a3367e7d-9072-41b3-8c16-1d66134a9522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153159 Aug 24 09:34:15.809317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 313/626] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:15 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:16.832166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:16.832813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:16.839451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:16.839976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:16.840416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:16.841108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:16.841661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:16.842036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:16.973936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:16.983179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:16.984706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:16.985855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c56ba0df-8f35-4ce0-817e-baeeb7b53f57 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157678 Aug 24 09:34:16.986409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 314/627] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:16 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:18.008179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:18.008705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:18.015151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:18.015658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:18.016094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:18.016773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:18.017222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:18.017647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:18.145470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:18.154140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:18.155655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:18.156842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-599d17db-a79c-4b35-803f-5c0e1e905198 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152606 Aug 24 09:34:18.157399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 314/628] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:19.181452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:19.181980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:19.188448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:19.188925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:19.189360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:19.190044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:19.190495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:19.190922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:19.315878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:19.325006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:19.326519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:19.327710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6dd76658-2afd-49cf-bf61-dcde1ea7116b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.150226 Aug 24 09:34:19.328268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 315/629] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:20.350478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:20.351097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:20.357544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:20.358023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:20.358462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:20.359145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:20.359618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:20.360040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:20.484110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:20.492593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:20.494094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:20.495893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ab62a359-d222-4d7b-901d-34db95e5b2a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.148693 Aug 24 09:34:20.496454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 315/630] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:21.518241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:21.518851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:21.525370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:21.525880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:21.526334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:21.527027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:21.527484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:21.527964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:21.651369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:21.659906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:21.661406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:21.662554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cdbf1eea-d8c1-4125-be80-a92c788f355e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.148254 Aug 24 09:34:21.663104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 316/631] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:21 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:22.685109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:22.685626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:22.691413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:22.691928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:22.692462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:22.693079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:22.693528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:22.693948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:22.826088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:22.834617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:22.836173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:22.837588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9b5b6da6-a24b-433b-8e16-5d8a73b74d08 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157159 Aug 24 09:34:22.838140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 316/632] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:23.860485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:23.861098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:23.868558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:23.869041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:23.869473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:23.870158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:23.870618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:23.871061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:24.001074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:24.009621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:24.011105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:24.012395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-89cd81c4-e06f-42d2-81c0-4adcc244eb0a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155842 Aug 24 09:34:24.012950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 317/633] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:25.035519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:25.036184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:25.042165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:25.043136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:25.043574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:25.044284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:25.044731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:25.045150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:25.175032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:25.184127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:25.185623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:25.186763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c36a9a43-e630-4d3e-b595-764aaa248d9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155324 Aug 24 09:34:25.187306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 317/634] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:26.209521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:26.210128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:26.216728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:26.217205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:26.217633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:26.218392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:26.218906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:26.219336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:26.347641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:26.356781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:26.358294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:26.372132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d9606916-5c31-4ab1-8ae5-864faeb1c1fb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153717 Aug 24 09:34:26.372706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 318/635] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:34:27.397681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:27.398291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:27.404258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:27.404735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:27.405162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:27.405839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:27.406295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:27.406714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:27.530953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:27.539479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:27.541001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:27.542154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f923300b-a91d-4069-b68c-e36f58a70cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.148370 Aug 24 09:34:27.543307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 318/636] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:28.565432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:28.566049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:28.572471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:28.572957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:28.573391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:28.574076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:28.574528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:28.574954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:28.718111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:28.726644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:28.728156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:28.729304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0177d1f1-2e83-4485-8b9f-0c5039eba80c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.167785 Aug 24 09:34:28.729854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 319/637] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:28 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:29.752667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:29.753278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:29.759110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:29.759608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:29.760040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:29.760717 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:29.761166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:29.761583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:29.890024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:29.898567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:29.900076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:29.901379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a2bef2d6-03d4-410e-b64d-4e59cd4a311e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152575 Aug 24 09:34:29.901935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 319/638] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:29 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:30.924013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:30.924625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:30.926908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=26 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:30.931571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:30.932080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:30.932516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:30.933204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:30.933659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:30.934084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:31.063763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:31.072574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:31.074101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:31.075813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3090f817-d755-4a56-b480-3f3bcfb06e8e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155680 Aug 24 09:34:31.076367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 320/639] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:30 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:32.099098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:32.099755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:32.101574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=26 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:32.106697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:32.107176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:32.107627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:32.108312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:32.108765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:32.115818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:32.237361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:32.247492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:32.249002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:32.250148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ac998868-3239-497e-b0d7-615c9fe6314d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154930 Aug 24 09:34:32.250699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 320/640] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:33.272250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:33.272869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:33.279865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:33.280351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:33.280790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:33.281480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:33.281956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:33.282382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:33.285035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=78 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:33.411638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:33.420938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:33.422441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:33.423666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-74e07d64-b622-442a-8a56-b2d81259ebcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155208 Aug 24 09:34:33.424235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 321/641] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:34.445480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:34.446139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:34.452063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:34.452549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:34.453018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:34.453707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:34.454158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:34.454578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:34.583335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:34.594562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:34.594778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:34.595974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bf6587d1-ca59-46f4-8d0b-1dc7e85da4c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154424 Aug 24 09:34:34.596528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 321/642] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:34 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:35.618196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:35.618761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:35.625041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:35.625512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:35.625940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:35.626620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:35.627065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:35.627490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:35.759915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:35.769286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:35.770803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:35.771994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3611d03b-de6e-4443-86fb-2f1f4bb13975 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157682 Aug 24 09:34:35.772549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 322/643] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:35 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:36.794338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:36.794970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:36.801002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:36.801474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:36.801903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:36.802576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:36.803023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:36.803437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:36.932571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:36.941036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:36.942526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:36.943690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-38ecae46-7bc3-462b-8780-933ef16b11a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153238 Aug 24 09:34:36.944247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 322/644] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:36 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:37.967660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:37.968191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:37.974074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:37.974557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:37.974991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:37.975709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:37.976168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:37.976594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:38.111421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:38.120701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:38.122243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:38.123657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-987a241d-a293-4077-88f5-635e51ab88a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.160457 Aug 24 09:34:38.124398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 323/645] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:37 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:39.146863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:39.147406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:39.153295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:39.153774 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:39.154211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:39.154898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:39.155378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:39.155838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:39.281371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:39.289781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:39.291264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:39.292437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8b064ea4-2ee2-488b-813c-bb349a7fcf23 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.149680 Aug 24 09:34:39.292993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 323/646] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:40.314669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:40.315310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:40.321733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:40.322214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:40.322651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:40.323336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:40.323826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:40.324253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:40.454605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:40.463296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:40.464834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:40.466481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7184c43e-91e2-4659-a9a1-8bae3bc10060 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155691 Aug 24 09:34:40.467035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 324/647] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:40 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:41.488387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:41.488992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:41.494813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:41.495287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:41.495753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:41.496429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:41.497483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:41.497903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:41.626522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:41.635013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:41.636543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:41.637748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-47e24f7b-e150-416c-8a83-78d7875a3712 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153224 Aug 24 09:34:41.638300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 324/648] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:41 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:42.660180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:42.660757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:42.667384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:42.667895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:42.668329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:42.669585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:42.670032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:42.670452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:42.798306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:42.806957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:42.808489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:42.809644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bc33c7c6-c431-4958-9970-0a9857c9943b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153424 Aug 24 09:34:42.810225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 325/649] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:42 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:43.836161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:43.836161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:43.839526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:43.840035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:43.840466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:43.841873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:43.842341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:43.842763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:43.845387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=78 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:43.972047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:43.980492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:43.982589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:43.983765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ea7457dd-77ee-4d51-8878-85826b5e2f7f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155535 Aug 24 09:34:43.984316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 325/650] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:45.006155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:45.006798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:45.014000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:45.014485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:45.014926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:45.015653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:45.016109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:45.016535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:45.152346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:45.161604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:45.163104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:45.164297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aa576662-69b0-4fe9-bb69-7aaa5805dbe7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.162009 Aug 24 09:34:45.164857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 326/651] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:45.900438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d89989ca-ef2a-43e9-981b-98966d1b5ba6"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:34:45.902825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:45.909443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:45.909923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:45.910352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:45.911033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:45.911480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:45.911926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:46.186542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:46.187188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:46.193640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:46.194262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:46.194596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:46.195288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:46.195781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:46.196212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:46.326984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:46.334000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:46.335495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:46.336953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-02c05e16-85f4-4ce7-a600-ee5d27d18b35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154761 Aug 24 09:34:46.337509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 327/652] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:34:46.738646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-727e898c-6fe9-455a-b340-836ff918b458 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "POST /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841867 Aug 24 09:34:46.739544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 326/653] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 09:34:45 2022] POST /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520/os-volume_attachments => generated 194 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:34:47.359348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:47.359986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:47.366268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:47.366749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:47.367186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:47.367918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:47.368372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:47.368796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:47.493122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:47.501497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:47.502981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:47.504221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-80b4f638-157b-40ac-bfac-fba6974ff3ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.148727 Aug 24 09:34:47.504805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 328/654] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:47 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:48.527536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:48.528798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:48.536153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:48.536647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:48.537079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:48.537770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:48.538228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:48.538655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:48.673149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:48.681926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:48.683443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:48.684767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-df1c398e-46d0-41f9-8451-f679994560cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.161549 Aug 24 09:34:48.685325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 327/655] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:48 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:49.707435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:49.708080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:49.714652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:49.715132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:49.716175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:49.716864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:49.717323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:49.717752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:49.847292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:49.855890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:49.857394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:49.858548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6baea9f5-873d-48c7-87ab-c40ace64be62 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155048 Aug 24 09:34:49.859111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 329/656] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:49 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:50.056927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:34:50.057114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:34:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:34:50.881542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:50.882158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:50.888682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:50.889164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:50.889603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:50.890289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:50.890744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:50.891173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:50.929930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:34:50.930126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:34:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc (ip 10.222.0.16) !!! Aug 24 09:34:51.023364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:51.032664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:51.034159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:51.035317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-46ccc12c-729f-43bf-bebb-6d01fa2c72e5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157675 Aug 24 09:34:51.035908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 328/657] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:50 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:52.057766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:52.058372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:52.065265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.065744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.066174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.066863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.067338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.067800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.095706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:52.096226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:52.102604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.103086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.103518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.104227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.104675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.105171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.128702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-33a6ae16-85fb-4cdb-bff8-91c29a9ffa08 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5/ips" status: 200 len: 150 microversion: 2.1 time: 0.037454 Aug 24 09:34:52.129293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 329/658] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 09:34:52 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:34:52.142607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "156aab15-cc6b-4aab-a58a-d47c2269e0c4"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:34:52.145017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:52.150898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.151382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.151864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.152580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.153031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.153456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.196508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:52.205510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:52.207005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:52.208343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-12336a2c-0930-4485-94b1-2cbd9926db30 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154409 Aug 24 09:34:52.208903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 330/659] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:52.232434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Invalid volume: volume 156aab15-cc6b-4aab-a58a-d47c2269e0c4 is already attached to instances: eb650451-50be-4714-b442-2a6cbcf96d6d Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: POST /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5/os-volume_attachments HTTP/1.1 Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 74 Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:34:52.235738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {"volumeAttachment": {"volumeId": "156aab15-cc6b-4aab-a58a-d47c2269e0c4"}} Aug 24 09:34:52.237079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Invalid volume: volume 156aab15-cc6b-4aab-a58a-d47c2269e0c4 is already attached to instances: eb650451-50be-4714-b442-2a6cbcf96d6d Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'server_id': '8e2c3983-8b10-4ca8-b317-368b1ebeffb5', 'body': {'volumeAttachment': {'volumeId': '156aab15-cc6b-4aab-a58a-d47c2269e0c4'}}} Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 156aab15-cc6b-4aab-a58a-d47c2269e0c4 is already attached to instances: eb650451-50be-4714-b442-2a6cbcf96d6d Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:34:52.237910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 156aab15-cc6b-4aab-a58a-d47c2269e0c4 is already attached to instances: eb650451-50be-4714-b442-2a6cbcf96d6d Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:34:52.239132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 156aab15-cc6b-4aab-a58a-d47c2269e0c4 is already attached to instances: eb650451-50be-4714-b442-2a6cbcf96d6d Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 400 to user: Invalid volume: volume 156aab15-cc6b-4aab-a58a-d47c2269e0c4 is already attached to instances: eb650451-50be-4714-b442-2a6cbcf96d6d {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-75ae17e1-7ef0-4e6f-b75a-b3b7ad5e660d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098467 Aug 24 09:34:52.240800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 330/660] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 09:34:52 2022] POST /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 24 09:34:52.246202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:52.247065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:52.252946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.253421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.253855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.254533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.254980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.255399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.280057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:34:52.517411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1593d451-7986-4f43-bb17-7dec11c7b5f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 204 len: 0 microversion: 2.1 time: 0.274594 Aug 24 09:34:52.518877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 331/661] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:34:52 2022] DELETE /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:34:52.526065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:52.526678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:52.534032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.534459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.534902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.535602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:52.536073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:52.536501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:52.663958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:52.671607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f908e1d8-03a6-4a2c-befb-d46c6a67337b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1682 microversion: 2.1 time: 0.149361 Aug 24 09:34:52.672168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 331/662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:34:52 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:34:53.232159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:53.232875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:53.239792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:53.240271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:53.240706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:53.241398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:53.241850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:53.242272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:53.381767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:53.390305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:53.391813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:53.392939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-04d63c07-82a4-4dbb-a184-b553a59fc8a1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.165194 Aug 24 09:34:53.393492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 332/663] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:53 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:53.692691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:53.693306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:53.699760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:53.700248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:53.700687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:53.701379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:53.701834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:53.702263 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:53.831027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:53.839558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f99ae068-08c3-4f2a-a336-d70a1c464965 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1682 microversion: 2.1 time: 0.150685 Aug 24 09:34:53.840155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 332/664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:34:53 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:34:54.415255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:54.416054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:54.423034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:54.423571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:54.424035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:54.424718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:54.425173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:54.425597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:54.550676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:54.559400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:54.561146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:54.562414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8b1b2a9c-d7f1-40eb-9279-29900057cc27 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151028 Aug 24 09:34:54.563289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 333/665] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:54.861348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:54.861968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:54.868385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:54.868871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:54.869307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:54.870036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:54.870493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:54.870918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:55.000967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:55.008633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e01e0d02-ef16-458e-a25f-60d4a346d10b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1682 microversion: 2.1 time: 0.151562 Aug 24 09:34:55.009209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 333/666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:34:54 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:34:55.585021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:55.585685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:55.594028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:55.594525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:55.595161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:55.595903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:55.596383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:55.596851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:55.879636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:55.900474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:55.909808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:55.909808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1f5d9acb-cc09-413d-9bab-4846e24b1c4d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.322993 Aug 24 09:34:55.909808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 334/667] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:55 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:56.019981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-b74924d1-916c-4545-aff7-315a93c1826c req-f9b1dadf-1379-49a8-87e4-21e2922ff819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e2c3983-8b10-4ca8-b317-368b1ebeffb5", "name": "network-vif-deleted", "tag": "471deb21-d81c-4019-8f2c-e159e47553f1"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:34:56.031059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:56.031906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b74924d1-916c-4545-aff7-315a93c1826c req-f9b1dadf-1379-49a8-87e4-21e2922ff819 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:56.032098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:56.032940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b74924d1-916c-4545-aff7-315a93c1826c req-f9b1dadf-1379-49a8-87e4-21e2922ff819 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:56.033526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b74924d1-916c-4545-aff7-315a93c1826c req-f9b1dadf-1379-49a8-87e4-21e2922ff819 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:56.038798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:56.039287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:56.039800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:56.040543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:56.054527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:56.055072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:56.060328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-b74924d1-916c-4545-aff7-315a93c1826c req-f9b1dadf-1379-49a8-87e4-21e2922ff819 service nova] Creating event network-vif-deleted:471deb21-d81c-4019-8f2c-e159e47553f1 for instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 on hv-cinder-85032 Aug 24 09:34:56.065898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-b74924d1-916c-4545-aff7-315a93c1826c req-f9b1dadf-1379-49a8-87e4-21e2922ff819 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.177693 Aug 24 09:34:56.066724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 334/668] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:34:56.130572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:56.139238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9fc7e51b-9750-42f8-8941-8c78ad899af2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 200 len: 1327 microversion: 2.1 time: 0.113509 Aug 24 09:34:56.140189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 335/669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:34:56 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:34:56.929140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:56.930094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:56.945167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:56.946908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:56.946908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:56.947529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:56.948193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:56.948626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:57.104264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:57.114960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:57.116811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:57.118015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-950aa17e-5184-4881-8262-77e13c53d698 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.193864 Aug 24 09:34:57.118585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 335/670] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:57.160286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:57.160860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:57.168855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:57.169344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:57.169776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:57.170476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:57.171441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:57.171906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:57.174887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:34:57.186350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 HTTP/1.1 Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:34:57.188562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 09:34:57.190026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '8e2c3983-8b10-4ca8-b317-368b1ebeffb5'} Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:34:57.190923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 09:34:57.196625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:34:57.197701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:34:57.197701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ec5667cd-cda2-4930-8415-5848c4bb79f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 404 len: 111 microversion: 2.1 time: 0.033720 Aug 24 09:34:57.197701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 336/671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:34:57 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:34:57.199507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e6fe9dbb-095b-481b-9ab8-de4875962898 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '.version_select at 0x7fa912efa5e0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:57.285043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e6fe9dbb-095b-481b-9ab8-de4875962898 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019154508" status: 202 len: 0 microversion: 2.1 time: 0.089789 Aug 24 09:34:57.285660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 336/672] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Aug 24 09:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1019154508 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:34:58.098369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:58.098893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:58.105072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:58.105549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:58.105982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:58.106655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:58.107103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:58.107522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:58.141878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:58.142522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:58.150893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:58.151386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:58.151852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:58.152553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:58.153011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:58.153442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:58.231990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lazy-loading 'services' on Instance uuid eb650451-50be-4714-b442-2a6cbcf96d6d {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:34:58.283390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:58.292233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:58.293712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:58.294856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-58e6ccfb-2093-4619-8027-6136189d8f1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157357 Aug 24 09:34:58.295403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 337/673] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:34:58.465711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-958a3302-1d80-42aa-a9bb-9dc4de04f387 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments/156aab15-cc6b-4aab-a58a-d47c2269e0c4" status: 202 len: 0 microversion: 2.1 time: 0.371356 Aug 24 09:34:58.466306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 337/674] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Aug 24 09:34:58 2022] DELETE /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments/156aab15-cc6b-4aab-a58a-d47c2269e0c4 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:34:58.474798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:58.476970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:58.485473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:58.485967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:58.486430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:58.487137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:58.487610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:58.488044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:58.517924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c2fe0181-60e2-49e7-a0e1-3903ee70472c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047074 Aug 24 09:34:58.518477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 338/675] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:34:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:34:59.317807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:59.318510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:59.324729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:59.325242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:59.325682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:59.326368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:59.326821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:59.327247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:59.456519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:59.465364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:59.466854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:34:59.468030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8de18271-7d2c-461e-b855-f50df3482bcc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155003 Aug 24 09:34:59.469109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 338/676] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:34:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:34:59.530413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:34:59.533158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:34:59.540010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:59.540498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:59.540938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:59.541637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:34:59.542094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:34:59.542803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:34:59.572958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-519c3e2e-e616-4597-9c02-feab521c3d55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046348 Aug 24 09:34:59.573509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 339/677] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:34:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:00.491217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:00.491847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:00.499346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:00.499857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:00.500297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:00.500978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:00.501428 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:00.501847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:00.585972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:00.588391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:00.595148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:00.595709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:00.596143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:00.596946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:00.597280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:00.597738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:00.628405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0975be36-049e-442a-8bd9-f32466a8f6df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047107 Aug 24 09:35:00.628963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 340/678] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:00.633697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:00.642277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:00.643802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:00.644957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b9bcaae4-8592-4179-992a-a443053dac45 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157647 Aug 24 09:35:00.645508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 339/679] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:01.640404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:01.642543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:01.649012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:01.649495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:01.649927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:01.650614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:01.651060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:01.651479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:01.667925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:01.668746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:01.671369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:01.677111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:01.677597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:01.678033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:01.678761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:01.679215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:01.679667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:01.682365 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f286a455-f82a-4ce9-a36a-cc6a285c2cfc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046061 Aug 24 09:35:01.686782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 341/680] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:01.814824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:01.823360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:01.824922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:01.826083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-820dc858-d9cb-48d9-9a19-671b637f3b20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.162234 Aug 24 09:35:01.826645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 340/681] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:01 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:02.694483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:02.696867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:02.700607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:02.704717 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:02.705142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:02.708744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:02.708744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:02.708744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:02.708744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:02.721213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:02.745786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-593d5a92-2123-47e2-b48d-a3247005c0cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055300 Aug 24 09:35:02.746345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 342/682] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:02.847911 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:02.848524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:02.854835 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:02.855337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:02.855806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:02.856488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:02.856940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:02.857359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:02.986278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:02.994845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:02.996477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:02.997572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9f754ab9-f58d-4986-b2b4-142b3e88f5a8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153542 Aug 24 09:35:02.998123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 341/683] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:03.759126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:03.761388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:03.768647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:03.769132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:03.769571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:03.770270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:03.770726 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:03.771161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:03.801562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6b5f8ae2-0332-44fe-be53-5913a683f4d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046819 Aug 24 09:35:03.802117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 343/684] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:04.022469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:04.023026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:04.029455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:04.029940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:04.030369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:04.031063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:04.032122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:04.032549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:04.164826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:04.173314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:04.174802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:04.175965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-39c4556b-1171-442b-8710-29f75a384152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157489 Aug 24 09:35:04.176517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 342/685] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:04.821073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:04.821945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:04.829595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:04.830078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:04.830513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:04.831211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:04.831692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:04.832120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:04.860997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0222c940-ece8-40bb-a6f5-6d3558cf1034 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045238 Aug 24 09:35:04.863129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 344/686] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:05.198663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:05.199308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:05.206182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:05.206669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:05.207105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:05.207821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:05.208283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:05.208714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:05.337221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:05.346434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:05.347971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:05.349129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8233680f-7750-4bfc-a7d1-5031bda41782 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154380 Aug 24 09:35:05.349688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 343/687] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:05.874456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:05.877213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:05.883449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:05.883966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:05.884397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:05.885082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:05.885532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:05.885953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:05.915801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ef4d083e-30a6-4ff6-957b-b170ddc985af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045320 Aug 24 09:35:05.916484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 345/688] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:06.371650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:06.372265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:06.378965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:06.379446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:06.379921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:06.380605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:06.381058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:06.381482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:06.505808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:06.514227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:06.516368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:06.517513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e56839d-8e0c-4c38-bbc4-936470336456 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.149808 Aug 24 09:35:06.518064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 344/689] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:06.928375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:06.930551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:06.937057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:06.937631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:06.938095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:06.938794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:06.939253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:06.940225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:06.969833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fcb000e3-9b00-4d17-8ca7-0d7370442154 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045597 Aug 24 09:35:06.970580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 346/690] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:07.539884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:07.540498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:07.547386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:07.547905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:07.548348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:07.549039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:07.549498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:07.549927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:07.677816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:07.686310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:07.688479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:07.689630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aef1ca98-8aa0-41c2-bee9-da7765c28096 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.153722 Aug 24 09:35:07.690181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 345/691] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:07 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:07.981966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:07.984053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:07.990926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:07.991406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:07.992058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:07.994141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:07.994141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:07.994141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:08.023412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e4e9ec69-b5c6-4f0f-bf20-20b8be8f3fb9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Aug 24 09:35:08.024014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 347/692] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:08.712531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:08.713125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:08.719540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:08.720053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:08.720495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:08.721184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:08.721643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:08.722068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:08.848652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:08.857000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:08.858484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:08.859735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3d913206-a996-47fd-b110-113093a2ca42 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151310 Aug 24 09:35:08.860301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 346/693] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:08 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:09.035675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:09.037818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:09.043972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:09.044489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:09.044898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:09.045540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:09.045995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:09.046419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:09.075869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0b3f0a7f-4599-4677-905c-13ce63af59a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044142 Aug 24 09:35:09.076440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 348/694] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:09.881918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:09.882528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:09.888950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:09.889435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:09.889938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:09.891102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:09.891553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:09.892012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:10.021500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:10.029968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:10.032127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:10.033316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7098a7a9-1f90-406a-9628-5127726a58e2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155256 Aug 24 09:35:10.033868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 347/695] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:09 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:10.088317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:10.090499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:10.097609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:10.097932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:10.098420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:10.099114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:10.099565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:10.100085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:10.129398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6ba1682a-b224-4994-8344-b857950319d9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045283 Aug 24 09:35:10.129955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 349/696] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:11.055831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:11.056583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:11.062900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:11.063373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:11.063842 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:11.064533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:11.064984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:11.065405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:11.142491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:11.144369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:11.152496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:11.153227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:11.153549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:11.154258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:11.154711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:11.155136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:11.188001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9993ade1-9de3-4f0d-bb67-9f23999bfcd7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049746 Aug 24 09:35:11.189061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 350/697] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:11.200041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:11.208740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:11.210235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:11.211728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b0722579-3ac9-4a6c-abc6-4a99090382fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.159556 Aug 24 09:35:11.212278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 348/698] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:11 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:12.200686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:12.203270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:12.210173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:12.210657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:12.211790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:12.212061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:12.212519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:12.212941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:12.234143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:12.235357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:12.241938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:12.242630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:12.243063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:12.243550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1256291c-1445-402b-85ab-bf6ca660bb09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046876 Aug 24 09:35:12.244151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 351/699] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:12.245318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:12.246182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:12.246683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:12.378998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:12.388080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:12.389598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:12.391349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-503bf43d-b5ee-4487-8b25-b776322bf373 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.160956 Aug 24 09:35:12.391921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 349/700] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:35:13.255375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:13.257538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:13.263799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:13.264275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:13.264707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:13.265415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:13.265861 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:13.266281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:13.296058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1321e1fa-c0cd-404d-acb8-04fa2d4d3e93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044513 Aug 24 09:35:13.302045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 352/701] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:13.413936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:13.422618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:13.422618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:13.422618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:13.422618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:13.423204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:13.423690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:13.424120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:13.558348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:13.567187 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:13.568728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:13.569881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8067d100-05ed-4234-9b17-9fbb356d59e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.159864 Aug 24 09:35:13.570446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 350/702] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:14.308860 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:14.310988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:14.318316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:14.318800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:14.319237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:14.319974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:14.327405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:14.327405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:14.352561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6645cb39-c693-4790-9c95-c737d2ced9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047523 Aug 24 09:35:14.356147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 353/703] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:14.598193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:14.598799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:14.605345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:14.605834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:14.606272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:14.607094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:14.607551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:14.608250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:14.735067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:14.743492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:14.744997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:14.746138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1370ede-07b9-42b6-8cc6-49444ecf44e0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152427 Aug 24 09:35:14.746690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 351/704] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:15.364992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:15.367103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:15.373566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:15.374044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:15.374482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:15.375816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:15.376273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:15.376697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:15.406592 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-92cba417-4b70-46f7-bff5-c06bfd218eab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045734 Aug 24 09:35:15.407145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 354/705] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:15.768954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:15.769556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:15.775852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:15.776327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:15.776760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:15.777438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:15.777887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:15.778305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:15.906274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:15.908434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:15.915276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:15.922250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:15.922250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a1f81445-d897-4062-a5e6-d5cf7e697320 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152899 Aug 24 09:35:15.922250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 352/706] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:15 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:16.418402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:16.420554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:16.426651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:16.427128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:16.427561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:16.428267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:16.428717 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:16.429138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:16.459995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-362c8372-6f6d-44dc-a312-66da1c41c1ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045488 Aug 24 09:35:16.460551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 355/707] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:16.943509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:16.944148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:16.951338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:16.955539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:16.955539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:16.955539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:16.955539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:16.955974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:17.081502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:17.088648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:17.090124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:17.091268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c3c3ec63-3fd4-4c9a-94f7-1ea124ad46d0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.151695 Aug 24 09:35:17.091852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 353/708] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:16 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:35:17.471959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:17.474138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:17.480468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:17.480947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:17.481377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:17.482054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:17.482531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:17.482948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:17.512186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c3647405-0e8c-48c4-8893-66b14ba353c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044135 Aug 24 09:35:17.512739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 356/709] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:18.114004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:18.114619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:18.121045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:18.123538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:18.123538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:18.123538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:18.123538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:18.123918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:18.253703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:18.262261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:18.263768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:18.264912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-32d12d52-ce47-4155-8b16-90056503d338 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155401 Aug 24 09:35:18.265462 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 354/710] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:18.524135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:18.526174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:18.533022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:18.533500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:18.533938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:18.534626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:18.535081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:18.535513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:18.564287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-85d7dc3a-9906-4305-9dd1-b50fa48054ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044131 Aug 24 09:35:18.564880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 357/711] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:19.287153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:19.287921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:19.294256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:19.294736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:19.295171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:19.295888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:19.296343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:19.296767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:19.424344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:19.432775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:19.434256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:19.435421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c05df9cc-7523-44e5-894d-7ff792f6125a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152137 Aug 24 09:35:19.436019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 355/712] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:19.576512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:19.578610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:19.584920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:19.585390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:19.585820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:19.586759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:19.587202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:19.587639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:19.616116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2583fa63-e55c-49d3-9b67-c68dde5da8f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043652 Aug 24 09:35:19.616669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 358/713] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:20.457609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:20.458211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:20.464796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:20.465273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:20.465702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:20.466380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:20.466826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:20.467245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:20.591528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:20.600551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:20.602026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:20.603164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-27c6a7c3-f533-410a-b4ab-c2c1cad078f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.149420 Aug 24 09:35:20.603736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 356/714] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:20.628187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:20.630316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:20.636683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:20.637158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:20.637587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:20.638258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:20.638727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:20.639144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:20.641488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:20.670733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-818c20de-a709-49e4-bfb6-565d8c64e39d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045999 Aug 24 09:35:20.670824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 359/715] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:21.625938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:21.626449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:21.632981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:21.633465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:21.633893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:21.634577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:21.635038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:21.635452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:21.682666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:21.684891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:21.691347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:21.691870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:21.692310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:21.693004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:21.693452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:21.693876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:21.724539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-18edc19e-cfe1-43f2-b9ef-b758cc0383b2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046103 Aug 24 09:35:21.725359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 360/716] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:21.767319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:21.776276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:21.777808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:21.778956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f312fd24-61b4-468c-b7e5-bba812f2d67e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.157022 Aug 24 09:35:21.779506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 357/717] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:21 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:22.737153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:22.739194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:22.745474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:22.745946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:22.746376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:22.747068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:22.747501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:22.747950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:22.776470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5d61eed8-7e88-4a8d-86a4-b59822cba74b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044018 Aug 24 09:35:22.777021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 361/718] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:22.802805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:22.803405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:22.809838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:22.810349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:22.811093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:22.812420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:22.812937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:22.813551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:22.950920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:22.959764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:22.961504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:22.962652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-208e70fa-830e-49cc-b006-076b09c2b22b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.163727 Aug 24 09:35:22.963196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 358/719] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:23.789031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:23.791151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:23.797484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:23.797957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:23.798387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:23.799063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:23.799511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:23.799958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:23.828393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-064fa891-d736-45bf-a3fe-85fa5214988c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043280 Aug 24 09:35:23.829543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 362/720] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:23.985876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:23.986476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:23.992623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:23.994626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:23.994626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:23.994626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:23.994626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:23.995061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:24.129587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:24.138387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:24.139887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:24.141029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-55ad1253-564f-4379-9d21-cf9042bf774c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.159541 Aug 24 09:35:24.141578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 359/721] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:24.841847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:24.844623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:24.850916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:24.851395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:24.851865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:24.852547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:24.852994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:24.853571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:24.882242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-09e59490-dc7a-43d8-90ca-eaac7388e743 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044520 Aug 24 09:35:24.882786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 363/722] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:25.162817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:25.163418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:25.169713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:25.170191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:25.170622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:25.171301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:25.171782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:25.172202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:25.297116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:25.305652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:25.307141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:25.308319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-740b5f8d-3681-4f5f-bacd-fdbab5bffdcd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.149323 Aug 24 09:35:25.308866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 360/723] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:25.894511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:25.896709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:25.903006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:25.903475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:25.903938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:25.904616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:25.905063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:25.905483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:25.933697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a68e2fe9-c203-4def-81cc-b96461c6eb14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043103 Aug 24 09:35:25.934172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 364/724] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:26.330652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:26.331308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:26.338114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:26.338594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:26.339029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:26.339747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:26.340202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:26.340625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:26.468093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:26.476572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:26.478047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:26.479272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-202c9128-d973-4fff-8ce3-5976dd24334f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.152468 Aug 24 09:35:26.479851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 361/725] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:26.946448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:26.948639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:26.954997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:26.955480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:26.956188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:26.957293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:26.957978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:26.958608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:26.990716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0313cc46-85e4-4331-80f7-ca524b3309e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048241 Aug 24 09:35:26.991276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 365/726] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:27.507778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:27.508309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:27.514834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:27.515316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:27.515785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:27.516474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:27.516925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:27.517380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:27.647413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:27.655836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:27.657825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:27.658958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-49157676-0033-4548-bcff-241b70fccb6c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.155492 Aug 24 09:35:27.659513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 362/727] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:28.002919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:28.005075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:28.011368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:28.011876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:28.012306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:28.012983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:28.013461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:28.013877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:28.042276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1287baef-3458-43da-9b33-9d3fd39056d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Aug 24 09:35:28.042811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 366/728] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:28.681283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:28.681884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:28.688640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:28.689123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:28.689611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:28.690381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:28.690859 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:28.691292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:28.820252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:28.829079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:28.830557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:28.831726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1cbcf7f2-7cc7-4741-b90d-69d3baefd2de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1754 microversion: 2.20 time: 0.154400 Aug 24 09:35:28.832306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 363/729] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:28 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1754 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:29.054861 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:29.057013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:29.064129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:29.064612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:29.065049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:29.065740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:29.066200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:29.066816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:29.095757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a0a74185-cc01-4423-a9ab-e4cfe6c70a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044769 Aug 24 09:35:29.096304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 367/730] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:29.854252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:29.854878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:29.861235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:29.861713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:29.862142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:29.862822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:29.863269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:29.863718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:29.991231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:30.000616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:30.002132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:30.003282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9368c214-8d78-47ce-84ad-3ee2edf3cb20 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152922 Aug 24 09:35:30.003865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 364/731] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:29 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:30.107270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:30.109408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:30.115839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:30.116318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:30.116748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:30.117432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:30.117881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:30.118304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:30.147605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6a80fd06-85c6-4323-a15c-2d49338fab86 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Aug 24 09:35:30.148151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 368/732] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:31.025956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:31.026609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:31.033538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:31.034025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:31.034479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:31.035166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:31.035661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:31.036099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:31.159606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:31.161793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:31.162556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:31.168334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:31.168819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:31.169258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:31.169952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:31.170403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:31.170830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:31.171139 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:31.173224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:31.174384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cd9d8a02-e382-43d5-ae3a-aeb014f66ca0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152353 Aug 24 09:35:31.174949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 365/733] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:31.200615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c04c168d-5aa2-4c94-aeeb-10c49ef2deea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Aug 24 09:35:31.201164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 369/734] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:32.198430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:32.199043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:32.201333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:32.206709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:32.207195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:32.207660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:32.208357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:32.208816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:32.209248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:32.212837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:32.214994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:32.222206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:32.222692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:32.223222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:32.223965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:32.224424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:32.224855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:32.253840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6fae66cb-04fd-49ef-a0fc-f913f25947f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Aug 24 09:35:32.254411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 370/735] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:32.344709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:32.353283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:32.354764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:32.355933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-667dae05-3608-44d0-98fc-756eabc0715b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.161413 Aug 24 09:35:32.356488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 366/736] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:33.265931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:33.268096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:33.274375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:33.274851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:33.275281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:33.275989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:33.276435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:33.276851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:33.306392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f17c288a-4629-47a5-9c16-b5feafa80360 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044582 Aug 24 09:35:33.306952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 371/737] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:33.380506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:33.381197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:33.387299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:33.390696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:33.390696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:33.390696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:33.390696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:33.391302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:33.523328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:33.532369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:33.533851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:33.534993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6d0169e4-c291-4f4b-8cb4-fe7c790023b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.159272 Aug 24 09:35:33.535538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 367/738] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:34.318708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:34.320875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:34.323104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=60 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:34.327923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:34.335182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:34.335182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:34.335182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:34.335182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:34.335573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:34.360958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d9e3f404-72aa-4ed7-ac33-5a6d743be384 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046160 Aug 24 09:35:34.361508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 372/739] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:34.557775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:34.558325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:34.565231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:34.565709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:34.566146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:34.566831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:34.567282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:34.567740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:34.700745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:34.709353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:34.710843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:34.712291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-efb2a395-7171-4d6c-b82c-f446ddf619c7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.158442 Aug 24 09:35:34.712850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 368/740] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:34 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:35.372602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:35.374770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:35.381075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:35.381544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:35.381972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:35.382673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:35.383121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:35.383541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:35.412649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7e8b5da5-d7d8-47f5-a515-163dd155f406 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Aug 24 09:35:35.413182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:35.734140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:35.734757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:35.741146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:35.741632 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:35.742074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:35.742762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:35.743220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:35.743674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:35.758402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:35.873619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:35.882737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:35.884281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:35.885465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-36ecc1ae-c91c-4c10-b109-77b6eaeb8a7e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155196 Aug 24 09:35:35.886037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 369/742] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:35 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:36.424761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:36.426884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:36.433198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:36.433678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:36.434117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:36.434810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:36.435262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:36.435720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:36.465275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fd0f8183-dc78-44f5-9f44-400e96e5cfe8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Aug 24 09:35:36.465815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 374/743] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:36.908796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:36.909335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:36.915160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:36.915668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:36.916109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:36.916787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:36.917235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:36.917654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:37.042570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:37.051652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:37.053138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:37.054285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-46941015-19bf-42ff-ab8f-e3a6ac15d286 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150129 Aug 24 09:35:37.054829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 370/744] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:36 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:37.477464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:37.479630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:37.486073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:37.486554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:37.487007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:37.487713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:37.488173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:37.488600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:37.512633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:37.517753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-84f14f74-4ac8-4017-a8d1-84e841d02dd3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Aug 24 09:35:37.518307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 375/745] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:38.077319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:38.078494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:38.085055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:38.089263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:38.089263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:38.089263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:38.089263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:38.089605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:38.217043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:38.225597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:38.227094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:38.228277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b097fc25-e9c0-45f2-9973-fa2bb5a2cec7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154896 Aug 24 09:35:38.228834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 371/746] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:38 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:38.529779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:38.531960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:38.538709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:38.539213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:38.539677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:38.540355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:38.540807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:38.541223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:38.570458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-445d2984-81f2-4ebc-a081-530472661f0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044583 Aug 24 09:35:38.571001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 376/747] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:39.252875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:39.253495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:39.259926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:39.260410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:39.260849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:39.261538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:39.261995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:39.262422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:39.388696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:39.397161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:39.398683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:39.399849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68560885-24c7-4f98-b8ef-5c782f367356 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151386 Aug 24 09:35:39.400401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 372/748] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:39.582571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:39.584773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:39.591347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:39.591855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:39.592292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:39.592972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:39.593931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:39.594357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:39.628056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-07fdf502-51b4-40b8-9803-1ce85558ed93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049189 Aug 24 09:35:39.628883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 377/749] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:40.423415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:40.424056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:40.430390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:40.430870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:40.431303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:40.432019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:40.432475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:40.432900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:40.559411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:40.568711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:40.570230 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:40.571381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7f93becd-227c-469f-9d10-8c43d7cf02a5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152569 Aug 24 09:35:40.571960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 373/750] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:40 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:40.641977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:40.644176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:40.650417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:40.650894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:40.651331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:40.652052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:40.652503 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:40.652928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:40.681508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6639b5db-e66b-4a34-a22e-61017fdfee4f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043416 Aug 24 09:35:40.682045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 378/751] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:41.594414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:41.595033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:41.601360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:41.601841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:41.602273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:41.602950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:41.603436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:41.603900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:41.693173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:41.695303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:41.701732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:41.702221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:41.702690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:41.703958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:41.704410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:41.704836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:41.733602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:41.733979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2179b2ed-f446-4159-babf-79e746d0d016 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Aug 24 09:35:41.734547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 379/752] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:41.742298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:41.743922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:41.745068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-67636928-85ba-4cde-9c27-68a9b0066abc tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154731 Aug 24 09:35:41.745612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 374/753] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:41 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:42.745364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:42.747435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:42.754496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:42.754974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:42.755466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:42.756183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:42.756640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:42.757061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:42.767854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:42.768474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:42.774744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:42.775225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:42.775688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:42.776380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:42.776835 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:42.777258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:42.785849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ead85511-0f95-4c6f-8dbb-dce330e472ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Aug 24 09:35:42.786412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 380/754] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:42.914874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:42.924295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:42.925781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:42.927053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4456adfa-5edc-48c2-a839-29137516b97d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.163226 Aug 24 09:35:42.928121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 375/755] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:42 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:35:43.798202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:43.800345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:43.806788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:43.807267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:43.807738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:43.808558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:43.809014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:43.809443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:43.839763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fb4c5260-d263-4001-9470-fd53c7906072 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Aug 24 09:35:43.840316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 381/756] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:43.951043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:43.967740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:43.967740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:43.967740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:43.967740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:43.968367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:43.968367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:43.968367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:44.104493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:44.112952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:44.114438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:44.115591 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f4ffadd7-3e53-4068-9f90-3b3068cd3235 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.169409 Aug 24 09:35:44.116149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 376/757] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:44.852129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:44.854447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:44.861374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:44.861856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:44.862294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:44.862987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:44.863442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:44.863901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:44.893148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25d9f34b-738a-45e2-b0a5-f6ada7904d59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Aug 24 09:35:44.893692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 382/758] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:45.138238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:45.138853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:45.145213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:45.145696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:45.146134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:45.146822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:45.147277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:45.147728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:45.287567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:45.296159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:45.298210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:45.304668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1184230d-6d5d-4ae9-bdc6-b41f64a1a314 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.170240 Aug 24 09:35:45.305135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 377/759] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:45.905408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:45.908136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:45.914436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:45.914914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:45.915345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:45.916066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:45.916518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:45.916941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:45.949958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ce7c0568-4d07-4335-9cee-c81d5114b518 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Aug 24 09:35:45.950818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 383/760] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:46.328344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:46.329408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:46.335832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:46.336578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:46.337124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:46.337691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:46.338144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:46.338561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:46.465600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:46.474044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:46.475513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:46.476682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a48b603f-7cd2-48e7-9e8f-520b50a43678 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152958 Aug 24 09:35:46.477235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 378/761] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:46.964406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:46.966480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:46.972904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:46.973378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:46.973815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:46.974501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:46.974954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:46.975407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:47.003534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-629f118d-5be7-4a91-bca7-99d8a4e4203a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043655 Aug 24 09:35:47.004109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 384/762] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:47.498257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:47.498928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:47.505977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:47.506458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:47.506892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:47.507577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:47.508060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:47.508482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:47.637759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:47.646205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:47.647730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:47.648880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b420b491-0427-4125-a6ad-455f663d8dec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154559 Aug 24 09:35:47.649433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 379/763] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:47 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:48.016397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:48.018424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:48.024856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:48.025335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:48.025772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:48.026464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:48.026917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:48.027341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:48.055323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a548b5b8-6442-4a90-8d7a-8975d7c57293 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043585 Aug 24 09:35:48.055902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 385/764] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:48.672158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:48.672682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:48.679569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:48.683331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:48.683331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:48.683331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:48.683331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:48.683747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:48.813191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:48.821862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:48.823474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:48.824586 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-64d86962-bfbe-4d50-bfbb-81f76f770662 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.157014 Aug 24 09:35:48.825127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 380/765] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:48 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:49.067540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:49.069700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:49.076044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:49.076526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:49.076959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:49.078144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:49.078593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:49.079018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:49.108420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1d83a73d-fad1-4ee3-bed7-ced0b9bcf0e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Aug 24 09:35:49.108972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 386/766] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:49.847515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:49.848159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:49.854534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:49.855017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:49.855449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:49.856169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:49.856622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:49.857046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:49.985579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:49.994047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:49.995542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:49.996711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2a636a56-01d6-48ec-b4ce-e7b28b43ffe8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153125 Aug 24 09:35:49.997264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 381/767] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:49 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:50.120880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:50.123003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:50.130082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:50.130561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:50.130995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:50.131736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:50.132199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:50.132623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:50.160500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bb4d8f09-8b2c-48bc-a7d7-181ec4ec915b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043681 Aug 24 09:35:50.161045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 387/768] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:51.020772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:51.021387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:51.027822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:51.028306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:51.028745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:51.029431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:51.029885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:51.030310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:51.159354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:51.167864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:51.169345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:51.170489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0fd342b0-9d50-479f-a245-a261d8419890 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153659 Aug 24 09:35:51.171032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 382/769] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:51 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:35:51.172595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:51.174758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:51.181128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:51.181675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:51.182109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:51.182798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:51.183253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:51.183705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:51.213218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-32cae0b8-789d-40da-8d33-5369482033ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Aug 24 09:35:51.213767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 388/770] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:52.193472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:52.194085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:52.200451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:52.200931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:52.201369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:52.202055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:52.202578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:52.203009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:52.225327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:52.227466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:52.234387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:52.234863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:52.235293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:52.236003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:52.236446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:52.236862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:52.266546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-04c60911-df52-4dff-b516-d26e1bd3fcf4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Aug 24 09:35:52.267316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 389/771] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:35:52.333227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:52.342095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:52.343662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:52.344828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0957583a-1bc8-48df-af52-fdcbe0205ff1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155217 Aug 24 09:35:52.345390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 383/772] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:53.278702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:53.280879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:53.287150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:53.287661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:53.288100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:53.288785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:53.289239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:53.289661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:53.318586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d3c02617-e55a-4fe4-b08c-b3ee3deab088 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Aug 24 09:35:53.319231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 390/773] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:53.367696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:53.368301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:53.375331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:53.376114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:53.376604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:53.377289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:53.377736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:53.378156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:53.507607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:53.516912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:53.518415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:53.519601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3537ef5f-e9b7-4fee-b35e-04882161d824 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155776 Aug 24 09:35:53.520167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 384/774] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:53 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:54.330961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:54.333148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:54.339830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:54.340315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:54.340757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:54.341567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:54.342028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:54.342457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:54.372796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b2ecabc9-f208-4ee8-a923-6608479b7e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046298 Aug 24 09:35:54.373374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 391/775] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:54.541352 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:54.541952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:54.548767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:54.549239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:54.549666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:54.550346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:54.550799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:54.551214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:54.681569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:54.691082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:54.692624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:54.693791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c2e744c0-83a3-437b-bbf8-c7a141db17d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156285 Aug 24 09:35:54.694354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 385/776] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:55.386322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:55.388472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:55.395929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:55.396440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:55.396875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:55.397566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:55.398087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:55.398716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:55.413373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:55.428887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-77e8db73-f99c-4d09-94fb-76069ba98bf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Aug 24 09:35:55.429437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 392/777] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:55.716762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:55.717373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:55.723821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:55.724315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:55.724754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:55.725449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:55.725910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:55.726339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:55.730256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:35:55.856021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:55.865150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:55.866585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:55.867770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1ebe6ea8-eda2-4257-a294-7b7402cd0b06 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154865 Aug 24 09:35:55.868329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 386/778] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:55 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:56.441206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:56.443376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:56.449998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:56.450474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:56.450902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:56.451575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:56.452052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:56.452470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:56.480893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ca1f90ff-a13c-4f96-846b-860b415234aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043670 Aug 24 09:35:56.481428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 393/779] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:56.890745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:56.891390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:56.897861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:56.898343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:56.898783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:56.899482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:56.899975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:56.900408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:57.028788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:57.037317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:57.038798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:57.039982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-86d6e31c-7076-4009-aad9-10cf587fef5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153614 Aug 24 09:35:57.040528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 387/780] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:57.494065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:57.496321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:57.503259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:57.503777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:57.504228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:57.504921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:57.505376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:57.505802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:57.535542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-22aa6e43-7ff9-4e2e-9622-d612e5cb7be5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Aug 24 09:35:57.536152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 394/781] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:58.062217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:58.062828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:58.069277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:58.069757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:58.070196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:58.070881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:58.071337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:58.071791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:58.200309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:58.209343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:58.210828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:58.212246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c78fb2a0-5314-4314-955d-8c179952ee29 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153937 Aug 24 09:35:58.212794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 388/782] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:58.547847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:58.549942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:58.556272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:58.556753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:58.557183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:58.557865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:58.558312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:58.558734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:58.588051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1adf7d70-3761-4b22-af38-4fd858580ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044277 Aug 24 09:35:58.588595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 395/783] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:35:59.235742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:59.236303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:59.242643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:59.243117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:59.243550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:59.244260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:59.244810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:59.245233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:59.372939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:59.382634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:59.384172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:35:59.385327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ca71eb00-9713-4963-96c9-5217ec2b7ac4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153773 Aug 24 09:35:59.385891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 389/784] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:35:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:35:59.600298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:35:59.602406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:35:59.609230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:59.609705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:59.610138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:59.610832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:35:59.611279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:35:59.611726 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:35:59.640318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2d713677-757c-432b-8924-4a23d270096c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044065 Aug 24 09:35:59.640855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 396/785] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:35:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:00.409726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:00.410336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:00.416652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:00.417127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:00.417560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:00.418240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:00.418690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:00.419111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:00.547435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:00.556018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:00.557451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:00.558592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e691efbb-e564-49fc-a319-cf8b50250e13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153472 Aug 24 09:36:00.559141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 390/786] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:00.652435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:00.654570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:00.661461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:00.661943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:00.662396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:00.663074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:00.663531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:00.663983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:00.693151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-56c51298-2125-48dd-8fb7-e6456d73be85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044700 Aug 24 09:36:00.693706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 397/787] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:01.581368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:01.581958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:01.588451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:01.588926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:01.589357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:01.590060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:01.590529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:01.590932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:01.705514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:01.707669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:01.714378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:01.714856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:01.715352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:01.716074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:01.716526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:01.716951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:01.721261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:01.729949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:01.731554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:01.732729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8ef3038f-7ad4-4197-bbe1-a2b2b7a72a96 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155335 Aug 24 09:36:01.733999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 391/788] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:01 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:01.746795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9b0886bc-c335-444d-a611-18a6b8319c7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045371 Aug 24 09:36:01.747533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 398/789] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:02.756054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:02.756674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:02.758802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:02.759208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:02.761020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:02.764267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:02.765387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:02.765822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:02.766525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:02.766987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:02.767438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:02.768059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:02.768536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:02.775459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:02.775459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:02.775459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:02.775459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:02.801405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9b87c80e-87ec-4405-b6c1-341d4003ae3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046313 Aug 24 09:36:02.806040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 399/790] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:03.166816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:03.175926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:03.177410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:03.178559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5b3e0bb9-141c-4eb3-b75f-2810447140db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.426437 Aug 24 09:36:03.179106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 392/791] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:03.813885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:03.816140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:03.822488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:03.822966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:03.823401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:03.824190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:03.824643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:03.825067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:03.854418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4573ffee-56c6-4752-a99b-b87f92becb7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044604 Aug 24 09:36:03.854964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 400/792] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:04.201517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:04.203492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:04.208977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:04.209459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:04.209940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:04.210575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:04.211043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:04.211738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:04.344555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:04.353092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:04.354580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:04.355759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cc5b1907-57b5-4335-90a7-032fad09cb3e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.158024 Aug 24 09:36:04.356299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 393/793] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:04.866462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:04.868629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:04.870945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=58 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:04.876168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:04.876653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:04.881206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:04.881206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:04.881206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:04.881206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:04.907916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5e573107-0d48-40aa-bcb3-a3e0771ce1f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Aug 24 09:36:04.909844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 401/794] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:05.379509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:05.380084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:05.386414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:05.386891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:05.387327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:05.388043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:05.388500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:05.388923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:05.514875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:05.523394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:05.524939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:05.526087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b8d25013-8349-483f-aa79-660eb2914b95 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150533 Aug 24 09:36:05.526633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 394/795] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:05.920240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:05.922974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:05.929585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:05.930062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:05.930493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:05.931172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:05.931645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:05.932068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:05.960450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25271411-3f13-4a02-ba77-7e164d064b59 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Aug 24 09:36:05.960924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 402/796] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:06.548872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:06.549468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:06.555341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:06.555858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:06.556299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:06.556989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:06.557453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:06.557880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:06.684350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:06.692865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:06.694360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:06.695511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2cf61d08-d85f-4aef-b7e9-605809de1864 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151376 Aug 24 09:36:06.696089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 395/797] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:06.973265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:06.975306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:06.981641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:06.982126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:06.982560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:06.983276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:06.983764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:06.984209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:07.012216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-90d923b3-22e2-4496-b80f-f5f26e54bb45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 Aug 24 09:36:07.012758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 403/798] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:07.718540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:07.719241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:07.725698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:07.726180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:07.726618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:07.727309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:07.727799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:07.728221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:07.852522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:07.861006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:07.862502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:07.863686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cce33a15-a5af-475f-8bba-3f21b036bcb3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.149653 Aug 24 09:36:07.864234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 396/799] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:07 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:08.025002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:08.027074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:08.033468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:08.033955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:08.034393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:08.035086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:08.035539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:08.036004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:08.064732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ed9fea45-7db1-4e5b-8a10-5cb6c51d852f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043857 Aug 24 09:36:08.065268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 404/800] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:08.886178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:08.886770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:08.893223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:08.893707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:08.894145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:08.894833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:08.895291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:08.895754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:09.024589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:09.033656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:09.035144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:09.036314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b0e62857-bf1f-448b-9a4d-c953fab512db tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154006 Aug 24 09:36:09.036851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 397/801] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:08 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:09.076744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:09.079477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:09.085859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:09.086632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:09.087073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:09.087809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:09.088270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:09.088701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:09.121976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5540eacf-fc5b-4c8f-8a87-dc5d8b205670 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049188 Aug 24 09:36:09.122530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 405/802] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:10.059028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:10.059667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:10.066689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:10.067172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:10.067627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:10.068315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:10.068769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:10.069195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:10.134525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:10.136692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:10.143080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:10.143561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:10.144074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:10.144766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:10.145552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:10.145671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:10.176478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9951813b-3b43-40fd-b403-5de42ce85e65 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Aug 24 09:36:10.177259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 406/803] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:10.196319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:10.204901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:10.206403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:10.207556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-63d6bdca-97e0-4228-af6f-89b59f3ab5eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152459 Aug 24 09:36:10.208127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 398/804] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:10 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:11.189137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:11.191269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:11.197635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:11.198117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:11.198555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:11.199244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:11.199731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:11.200157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:11.228989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8f3ab6b8-58c2-45d9-8d9b-f88de6827bb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Aug 24 09:36:11.229535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 407/805] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:11.230310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:11.230988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:11.237818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:11.238292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:11.238729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:11.239411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:11.239889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:11.240311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:11.370080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:11.380118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:11.381602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:11.382795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6171acbd-4e99-4954-83a7-db5a492eddc3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156446 Aug 24 09:36:11.383344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 399/806] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:11 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:36:12.241910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:12.244245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:12.251158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:12.251760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:12.252366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:12.253165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:12.253620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:12.254298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:12.285791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dbde4642-5911-4fe4-a43e-fd6f95cca978 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047971 Aug 24 09:36:12.286357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 408/807] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:12.405353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:12.406392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:12.419725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:12.420286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:12.420965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:12.421897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:12.422359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:12.422786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:12.565836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:12.576060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:12.577533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:12.578705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e4ac5d0c-b2b1-44af-91d2-9a7e1198de63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.177467 Aug 24 09:36:12.579252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 400/808] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:13.298280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:13.300450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:13.306693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:13.307174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:13.307632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:13.308329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:13.308783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:13.309208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:13.312168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:13.340283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-759db791-76f5-4dae-8588-f6c120be8f45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046035 Aug 24 09:36:13.341054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 409/809] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:13.602000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:13.602757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:13.609949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:13.610431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:13.610866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:13.611556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:13.612037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:13.612491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:13.742778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:13.752625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:13.754111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:13.755270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-abfc5aaf-374a-4f18-a165-1df0c0b2c650 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.157094 Aug 24 09:36:13.755863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 401/810] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:14.353217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:14.355345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:14.361994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:14.362474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:14.362911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:14.363610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:14.364074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:14.364498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:14.393555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dc1ec247-63c5-40e4-8f2c-9ac7eea0d711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044625 Aug 24 09:36:14.394103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 410/811] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:14.781726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:14.782337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:14.788687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:14.789163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:14.789595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:14.790281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:14.790733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:14.791156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:14.921256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:14.923444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:14.930370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:14.931907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:14.933047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1ffc174a-2e06-44e5-b805-00b0aac90da5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155792 Aug 24 09:36:14.933596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 402/812] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:15.407404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:15.409457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:15.415244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:15.415780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:15.416214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:15.416893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:15.417352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:15.417772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:15.446401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4b587620-210d-4c7c-a890-88675ff5d64a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044611 Aug 24 09:36:15.446936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 411/813] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:15.956434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:15.956983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:15.964006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:15.964488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:15.964923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:15.965612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:15.966067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:15.966493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:16.091777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:16.101104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:16.102568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:16.103933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e69124ee-7712-4fc2-ace3-c1456362d333 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151269 Aug 24 09:36:16.109343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 403/814] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:15 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:16.459609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:16.462030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:16.467990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:16.468476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:16.468967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:16.469672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:16.470131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:16.470559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:16.506962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0dd1dde8-2c0f-45eb-9330-0e66312f61d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051183 Aug 24 09:36:16.507735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 412/815] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:17.128740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:17.129691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:17.138728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:17.139393 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:17.140085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:17.141228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:17.141734 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:17.142172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:17.269248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:17.277939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:17.279442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:17.281206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d326b6e2-5953-4ea9-8313-1e18e861206d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.158273 Aug 24 09:36:17.281758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 404/816] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:17 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:17.520076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:17.522163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:17.528424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:17.528901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:17.529329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:17.530614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:17.531060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:17.531480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:17.559270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fed7491c-0125-4d87-ae82-4c6f6781d2bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043262 Aug 24 09:36:17.559835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 413/817] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:18.303456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:18.304033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:18.310611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:18.311089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:18.311520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:18.312228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:18.312680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:18.313103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:18.441651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:18.450123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:18.452285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:18.453429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8c5beec8-63ce-4987-a421-f18add951a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153859 Aug 24 09:36:18.453977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 405/818] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:36:18.571374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:18.573491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:18.580535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:18.581011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:18.581446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:18.582129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:18.582581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:18.583004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:18.611651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f969a09d-4993-4f49-9eef-c81d43dc9bb8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044217 Aug 24 09:36:18.612206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 414/819] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:19.476485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:19.477100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:19.484105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:19.484590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:19.485028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:19.485722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:19.486182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:19.486609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:19.610669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:19.619224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:19.620758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:19.621928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0fa346de-f309-446f-b5f7-833d1dfa0dff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.149349 Aug 24 09:36:19.622485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 406/820] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:19.623964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:19.626273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:19.632776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:19.633262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:19.633701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:19.634399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:19.634857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:19.635293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:19.664915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7406fc76-5781-4fbe-b202-d0b5d396446a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045117 Aug 24 09:36:19.665471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 415/821] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:20.643830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:20.644383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:20.650796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:20.651276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:20.651752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:20.652448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:20.652906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:20.653337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:20.677596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:20.679760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:20.686105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:20.686587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:20.687022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:20.687754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:20.688208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:20.688632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:20.718256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-11c8f343-fefe-4310-a5b9-ac3b64f1868f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Aug 24 09:36:20.718821 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 416/822] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:21.023182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:21.033348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:21.034992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:21.036209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-69b868a5-a008-4738-9383-3678d00f1375 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.396385 Aug 24 09:36:21.036762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 407/823] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:21.730406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:21.733056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:21.739375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:21.739894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:21.740331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:21.741046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:21.741496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:21.741921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:21.771720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6e125cb8-6cc8-47a9-bae8-8cf0e81dd226 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045237 Aug 24 09:36:21.772268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 417/824] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:22.062085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:22.062713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:22.069178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:22.069661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:22.070100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:22.070795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:22.071250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:22.071709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:22.197147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:22.205697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:22.207157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:22.208329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-389fdf27-2850-4c1e-b95c-34f2177ed9b6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150638 Aug 24 09:36:22.208874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 408/825] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:22.784511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:22.786619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:22.792908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:22.793388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:22.793823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:22.794509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:22.794966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:22.795385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:22.823270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e8617c33-51fc-495b-854f-d8c75411bb90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 Aug 24 09:36:22.823842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 418/826] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:23.231864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:23.232495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:23.239289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:23.239801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:23.240234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:23.241189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:23.241644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:23.242064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:23.368490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:23.377837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:23.379384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:23.386324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-55c79d89-c02a-4823-aff3-a1b1bb36de73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152616 Aug 24 09:36:23.386324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 409/827] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:23.835926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:23.838290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:23.845206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:23.845679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:23.846110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:23.846790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:23.847234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:23.847677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:23.876393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6366d241-e921-4f81-b9fa-7de58f941bf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044418 Aug 24 09:36:23.876937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 419/828] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:24.406993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:24.407616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:24.413898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:24.414372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:24.414805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:24.415486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:24.415962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:24.416380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:24.542026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:24.550834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:24.552353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:24.553559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-98224856-b138-42b5-95f0-43c15de1cdbd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150440 Aug 24 09:36:24.554048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 410/829] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:24 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:36:24.888194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:24.890353 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:24.896764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:24.897266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:24.897704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:24.898399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:24.898852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:24.899280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:24.928483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bb8ec1bb-52a5-487b-b7e5-7bba26d45954 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044269 Aug 24 09:36:24.929032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 420/830] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:25.576524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:25.577641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:25.584029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:25.584507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:25.584940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:25.585626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:25.586338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:25.586764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:25.717436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:25.726555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:25.728092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:25.729251 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-933cdfff-c4f6-455d-8701-37286b05e1d7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156662 Aug 24 09:36:25.729808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 411/831] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:25.941272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:25.943450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:25.949805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:25.950292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:25.950732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:25.951420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:25.952602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:25.953066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:25.981711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cb57fcdb-d704-41d2-9282-c6313334ce90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Aug 24 09:36:25.982282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 421/832] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:26.751780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:26.752398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:26.758946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:26.759434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:26.759896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:26.760589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:26.761056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:26.761502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:26.891932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:26.900594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:26.902133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:26.903292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-23c2a52f-f1dd-433f-9832-32613884fae4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155449 Aug 24 09:36:26.903872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 412/833] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:26.993748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:26.995906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:27.002277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:27.002697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:27.003135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:27.003852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:27.004306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:27.004730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:27.034065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a5c771ff-55e6-4a2d-8f68-928da5752bbf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044242 Aug 24 09:36:27.034609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 422/834] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:27.929370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:27.929963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:27.936329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:27.937320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:27.937755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:27.938432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:27.938883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:27.939307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:28.046727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:28.048915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:28.055115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:28.055606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:28.056050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:28.056742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:28.057191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:28.057611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:28.070046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:28.078718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:28.080292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:28.081469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4fedca97-11c2-4d39-9dbc-7183b84fbb35 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155989 Aug 24 09:36:28.082147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 413/835] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:28.089122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ef3158fd-3f61-4147-ab53-e8fa0465445e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046538 Aug 24 09:36:28.089679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 423/836] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:28.457143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:36:28.457315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:36:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:36:29.102198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:29.104595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:29.108623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:29.109275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:29.111149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:29.111662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:29.112104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:29.112795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:29.113247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:29.113666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:29.115822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:29.116307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:29.116750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:29.117447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:29.117917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:29.118336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:29.144253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-56c9265e-d0ee-4fe8-9551-6500691e98da tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046010 Aug 24 09:36:29.147184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 414/837] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:29.249830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:29.258333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:29.259885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:29.261049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-045a1142-73b2-466e-98fc-d60a4ca6f6ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156237 Aug 24 09:36:29.261607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 424/838] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:29 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:36:30.157158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:30.159418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:30.165852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:30.166336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:30.166773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:30.167465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:30.167952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:30.168382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:30.196383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1d1be048-0e84-4609-ab13-f98c1a29db51 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043745 Aug 24 09:36:30.196918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 415/839] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:30.284175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:30.284774 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:30.291060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:30.291535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:30.291996 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:30.292674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:30.293124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:30.293544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:30.422216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:30.424483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:30.432068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:30.433875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:30.435155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3e81bde2-c151-4f99-aa92-04b246119e03 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155470 Aug 24 09:36:30.436729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 425/840] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:30 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:31.208814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:31.210995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:31.219181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:31.219691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:31.220125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:31.220808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:31.221263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:31.221688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:31.252213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b8fd6b7e-2b86-4496-a1c6-e60cc113297f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Aug 24 09:36:31.252753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 416/841] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:31.459402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:31.460039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:31.466696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:31.467178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:31.467628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:31.468321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:31.468772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:31.469193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:31.604723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:31.613880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:31.615388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:31.616567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5bb136a0-9bd9-4fbe-b669-b4a7f022b670 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.161439 Aug 24 09:36:31.617124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 426/842] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:32.264914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:32.267039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:32.273485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:32.273967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:32.274402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:32.275084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:32.275535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:32.275986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:32.304686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-678e6d6b-008c-44e0-adba-28bba4a05c46 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044219 Aug 24 09:36:32.305240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 417/843] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:32.640027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:32.640633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:32.650077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:32.650077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:32.650077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:32.650077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:32.650462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:32.650462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:32.779121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:32.788212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:32.790010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:32.791167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f5d4b5f3-8770-4594-b8d1-e27a646c313a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155002 Aug 24 09:36:32.791769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 427/844] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:33.317366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:33.319498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:33.321759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:33.326407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:33.326885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:33.327318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:33.328027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:33.328479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:33.328900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:33.357999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f25cddd7-04df-4158-95dc-b8b01a2d952a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Aug 24 09:36:33.359075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 418/845] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:33.814683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:33.815242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:33.821647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:33.822133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:33.822575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:33.823266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:33.823752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:33.824185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:33.955094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:33.964646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:33.966175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:33.967389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-71f18079-0ab8-40b0-8970-f3e3697fd556 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156609 Aug 24 09:36:33.968699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 428/846] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:34.370434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:34.372644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:34.379831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:34.380302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:34.380735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:34.381415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:34.381861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:34.382291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:34.396119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:34.411080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-56b2f1b4-7dcc-456d-9102-8554b8cf3800 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044608 Aug 24 09:36:34.411639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 419/847] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:34.990538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:34.991103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:34.997372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:34.997846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:34.998276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:34.998985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:34.999432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:34.999877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:35.128248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:35.136642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:35.138128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:35.139266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8d6165af-b166-4767-acc3-acb4912ce064 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152710 Aug 24 09:36:35.139858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 429/848] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:34 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:35.423127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:35.425288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:35.431857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:35.432340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:35.432808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:35.433499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:35.433957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:35.434386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:35.463253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1d6d066c-49c5-4ca8-9167-f314871fd039 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Aug 24 09:36:35.463821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 420/849] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:36.162232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:36.162767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:36.165039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=58 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:36.169633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:36.170111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:36.170832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:36.171217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:36.171692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:36.172115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:36.297974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:36.308176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:36.309662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:36.310819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1ceecf08-afda-482b-960a-b336630c6f5c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152615 Aug 24 09:36:36.311398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 430/850] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:36 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:36.476273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:36.478346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:36.484227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:36.484710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:36.485138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:36.485816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:36.486264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:36.486682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:36.515557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51ca81fe-e2fd-4e43-a737-0e2763f5a174 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043520 Aug 24 09:36:36.516106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 421/851] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:37.332448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:37.333090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:37.339786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:37.340270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:37.340709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:37.341401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:37.341856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:37.342289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:37.471180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:37.479698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:37.481186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:37.482323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f5896c48-06ef-4273-86ab-166b38db8cb1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153852 Aug 24 09:36:37.482878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 431/852] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:37 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:37.527535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:37.529754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:37.536664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:37.537146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:37.537583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:37.538267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:37.538725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:37.539149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:37.567002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-50ab4173-1d52-4033-8250-d9bc4887a40f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043347 Aug 24 09:36:37.567474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 422/853] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:38.504924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:38.505561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:38.511926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:38.512407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:38.512840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:38.513524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:38.513979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:38.514898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:38.579726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:38.581772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:38.588669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:38.589234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:38.589744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:38.590532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:38.591063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:38.591574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:38.621497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a5a86b1d-800e-41ca-8e8e-549ed337ebd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046295 Aug 24 09:36:38.622057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 423/854] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:38.643795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:38.652285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:38.653795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:38.654943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b9fefb98-37d8-460d-ab0c-a9890f3293de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153962 Aug 24 09:36:38.655490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 432/855] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:38 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:39.634202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:39.636295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:39.642580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:39.643060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:39.643494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:39.644205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:39.644659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:39.645086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:39.674196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f1ac51f5-0e84-4863-b0c8-8a5d2f90cbcc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043996 Aug 24 09:36:39.674738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 424/856] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:39.677652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:39.678262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:39.684714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:39.685188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:39.685624 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:39.686321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:39.686768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:39.687187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:39.818954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:39.828007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:39.829490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:39.830631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-674752e2-d09a-442a-9f40-bc4557fb4b61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156756 Aug 24 09:36:39.831178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 433/857] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:40.687312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:40.689379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:40.695786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:40.696262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:40.696695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:40.697372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:40.697821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:40.698240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:40.727743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3ec45421-8f13-46ed-8a03-12dec00ee135 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045161 Aug 24 09:36:40.728305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 425/858] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:40.853618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:40.854234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:40.861190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:40.861678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:40.862119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:40.862808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:40.863266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:40.863724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:40.994807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:41.007403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:41.008928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:41.010076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-76474ffb-8972-46bf-b467-07d53168aaa6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.160397 Aug 24 09:36:41.010870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 434/859] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:40 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:41.739496 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:41.741689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:41.748182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:41.749360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:41.750056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:41.750860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:41.751314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:41.751773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:41.780206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b853d698-2beb-42f8-9f4c-46383ff2cd9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044646 Aug 24 09:36:41.780752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 426/860] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:42.032046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:42.032663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:42.039069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:42.039557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:42.040019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:42.040714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:42.041169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:42.041597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:42.177784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:42.187378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:42.188963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:42.190117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-315ed6b0-3f94-41a3-b7bd-68fdeadbaf07 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.162017 Aug 24 09:36:42.190656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 435/861] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:42 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:42.792412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:42.794552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:42.800918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:42.801398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:42.801833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:42.802522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:42.802978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:42.803402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:42.832288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f39342c7-c214-4e31-b45d-3cb6a8dbae62 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043830 Aug 24 09:36:42.832832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 427/862] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:43.212697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:43.213307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:43.219602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:43.220163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:43.220614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:43.221183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:43.221636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:43.222123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:43.350404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:43.358865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:43.360405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:43.361561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0b34052d-bdc9-41c1-8d6e-3ab712b7a77f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153016 Aug 24 09:36:43.362119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 436/863] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:43.845411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:43.847545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:43.856143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:43.856624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:43.857059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:43.857782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:43.858240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:43.858662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:43.888372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ed81843-0130-467c-8858-7db1c063205f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047447 Aug 24 09:36:43.888932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 428/864] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:44.384690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:44.385253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:44.392369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:44.392852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:44.393319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:44.394007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:44.394461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:44.394884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:44.519488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:44.528073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:44.530137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:44.531274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-04cbe51e-68e5-4772-b023-fc38388f3d79 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150613 Aug 24 09:36:44.531855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 437/865] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:44 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:44.900968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:44.903269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:44.910088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:44.910565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:44.910996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:44.911702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:44.912151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:44.912568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:44.941076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8fa5ca75-d3ac-432b-812e-0ab1dbd1cbc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044325 Aug 24 09:36:44.941613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 429/866] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:45.553556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:45.554181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:45.560670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:45.561152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:45.562111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:45.562807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:45.563261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:45.563724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:45.689344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:45.697900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:45.699406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:45.700595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c6f7688f-fbc0-4403-99be-e3fe783f1ff7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150945 Aug 24 09:36:45.701183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 438/867] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:45.953366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:45.955440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:45.962159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:45.962641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:45.963081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:45.963796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:45.964255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:45.964683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:45.993335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1ebf8fd7-67d6-4edb-a26b-f9f770778675 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044054 Aug 24 09:36:45.993882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 430/868] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:46.724567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:46.725209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:46.731495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:46.732008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:46.732449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:46.733145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:46.734111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:46.734536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:46.867286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:46.876002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:46.877508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:46.878750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f09e1528-b7d1-4b8a-a7f6-7b773fb88e31 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.158146 Aug 24 09:36:46.879311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 439/869] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:47.005561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:47.007674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:47.013995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:47.014472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:47.014903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:47.015610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:47.016064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:47.016490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:47.045213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fe12004d-81b0-41c3-86f1-d2c9038039d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043711 Aug 24 09:36:47.045754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 431/870] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:47.908246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:47.909308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:47.915804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:47.916281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:47.916709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:47.917389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:47.917839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:47.918368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:48.043638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:48.052568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:48.054063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:48.055211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3941b635-500c-4961-8d2d-a54fe0b34070 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150859 Aug 24 09:36:48.055795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 440/871] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:47 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:48.057313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:48.059457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:48.066501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:48.066976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:48.067414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:48.068142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:48.068599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:48.069028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:48.098613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-856c6db1-1c90-4974-af8d-fa90429eeda6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045124 Aug 24 09:36:48.099192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 432/872] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:49.088515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:49.089125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:49.095834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:49.096344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:49.096782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:49.097471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:49.097929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:49.098357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:49.110256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:49.112388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:49.119512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:49.124444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:49.124444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:49.124444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:49.124444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:49.124839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:49.152777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-85871f5b-103e-44bb-ab1b-ddba56d57788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046498 Aug 24 09:36:49.153328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 433/873] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:49.228053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:49.236550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:49.238041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:49.239192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7b842bea-87f0-4c27-9c7e-e1984d4f50a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154845 Aug 24 09:36:49.239783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 441/874] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:49 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:50.165033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:50.167238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:50.173649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:50.174129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:50.174564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:50.175248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:50.175731 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:50.176158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:50.205165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-786e80eb-110d-4f62-b157-d7a7eab1198e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044099 Aug 24 09:36:50.205709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 434/875] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:50.261985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:50.262597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:50.268991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:50.269471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:50.269905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:50.270591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:50.271044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:50.271469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:50.285752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:50.398735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:50.407419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:50.408962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:50.410111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9d4b5711-f91a-4308-b0c9-55df6d4ceb1b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152002 Aug 24 09:36:50.410668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 442/876] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:50 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:51.218171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:51.220371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:51.226736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:51.227220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:51.227686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:51.228381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:51.228840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:51.229270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:51.257600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3eaa7071-612f-426d-a56f-8acb05154861 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043946 Aug 24 09:36:51.258139 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 435/877] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:51.433423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:51.434035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:51.440979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:51.441463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:51.441902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:51.442769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:51.443230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:51.443679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:51.571018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:51.580143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:51.581639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:51.582797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a23986ca-ea07-4a34-b021-10e64be43882 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153306 Aug 24 09:36:51.583355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 443/878] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:51 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:52.269694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:52.271872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:52.278282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:52.278761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:52.279201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:52.279910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:52.280867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:52.281290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:52.283631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:36:52.311347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3233b6cb-0a57-481d-b803-fea9bb66cbd9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045643 Aug 24 09:36:52.311979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 436/879] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:52.606096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:52.606745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:52.613257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:52.617912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:52.617912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:52.617912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:52.617912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:52.618285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:52.749317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:52.758111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:52.759684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:52.760856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8c4b841e-9ebd-4faa-9664-7aa11a495863 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.158738 Aug 24 09:36:52.761431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 444/880] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:53.323753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:53.325931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:53.332400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:53.332885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:53.333320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:53.334011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:53.334465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:53.334891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:53.363635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2c28f3ec-c717-4c2b-92bc-9695dc189351 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044211 Aug 24 09:36:53.364182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 437/881] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:53.788613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:53.789337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:53.796461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:53.797017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:53.797520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:53.798283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:53.798826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:53.799298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:53.932580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:53.941118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:53.942595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:53.943764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3710e90f-932f-4284-8a08-f980243f278c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.158928 Aug 24 09:36:53.944317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 445/882] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:53 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:54.376453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:54.378592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:54.385026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:54.385510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:54.385944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:54.386631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:54.387084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:54.387505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:54.416335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-20d23273-83ae-4119-9324-46a888751444 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044389 Aug 24 09:36:54.416886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 438/883] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:54.966351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:54.966964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:54.973399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:54.973882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:54.974331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:54.975003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:54.975456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:54.975904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:55.104259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:55.113594 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:55.117750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:55.117750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7836a7af-119c-4017-8580-88555384f0e3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153780 Aug 24 09:36:55.117750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 446/884] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:55.428577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:55.430697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:55.437101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:55.437577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:55.438006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:55.438684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:55.439134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:55.439554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:55.469546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3ab10d52-c389-4659-8411-4f2e0016e2e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044976 Aug 24 09:36:55.470103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 439/885] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:56.138203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:56.138823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:56.145939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:56.146426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:56.146868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:56.147560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:56.148068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:56.148504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:56.273633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:56.282206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:56.283752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:56.284905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b56ec676-32d4-45e2-93f2-cd6d7274e7cf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150624 Aug 24 09:36:56.285461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 447/886] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:56.481758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:56.483847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:56.490623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:56.491100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:56.491531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:56.492239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:56.492690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:56.493111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:56.521876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7dac015b-f704-41ae-962a-e2b6a6ce6789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044112 Aug 24 09:36:56.522415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 440/887] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:57.308430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:57.309039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:57.315850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:57.316327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:57.316755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:57.317431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:57.317880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:57.318296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:57.447070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:57.456161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:57.457657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:57.458797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-92284ccb-0887-4bfd-962d-06ec3faebfd0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154263 Aug 24 09:36:57.459348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 448/888] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:57 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:57.533842 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:57.536048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:57.542429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:57.542915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:57.543352 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:57.544081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:57.544537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:57.544961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:57.573426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-44748e3c-eacc-4ac3-b8d7-80ccddfcffec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Aug 24 09:36:57.573906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 441/889] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:58.481851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:58.482458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:58.489290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:58.489765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:58.490195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:58.490873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:58.491317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:58.491771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:58.585524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:58.588006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:58.594311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:58.594802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:58.595244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:58.595968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:58.596429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:58.596858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:58.617501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:58.626737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:58.626897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d8901d89-803a-498c-bac7-2c9720dddd2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Aug 24 09:36:58.627413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 442/890] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:36:58.628512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:58.629663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9233a5af-41cb-4eee-a8e9-fda138a4a1c4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151739 Aug 24 09:36:58.630203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 449/891] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:36:59.639133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:59.641839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:59.648312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:59.648794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:59.649230 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:59.649918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:59.650396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:59.650824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:59.651854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:36:59.652461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:36:59.658822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:59.659298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:59.659792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:59.660478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:36:59.660926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:36:59.661345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:36:59.680203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-381a68a9-b8c8-4fac-ba1a-2d563b1d8023 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045043 Aug 24 09:36:59.680766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 443/892] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:36:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:36:59.786754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:59.795350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:59.797219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:36:59.798378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8f7d913f-6605-4dde-ba80-5ea0768f5065 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150410 Aug 24 09:36:59.798944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 450/893] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:36:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:37:00.693101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:00.695134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:00.701631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:00.702108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:00.702544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:00.703285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:00.703776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:00.704201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:00.732912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d5c03a87-af7a-4c59-9a28-6c9644208a4a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Aug 24 09:37:00.733460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 444/894] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:00.821397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:00.822009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:00.829020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:00.829506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:00.829941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:00.830634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:00.831091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:00.831514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:00.966949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:00.976102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:00.977593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:00.978734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-388b68a8-50bf-4024-a9f1-15d8c6290728 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.161309 Aug 24 09:37:00.979293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 451/895] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:01.744881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:01.747010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:01.753487 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:01.753988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:01.754421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:01.755130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:01.755602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:01.756021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:01.785384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-34334c06-87ae-46dc-b58d-511f873d290b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044491 Aug 24 09:37:01.785930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 445/896] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:02.001956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:02.002479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:02.008793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:02.009270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:02.009704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:02.010389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:02.010847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:02.011272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:02.136886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:02.146146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:02.147674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:02.148830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-08b81924-2f37-43c1-bfb1-d2afc6f7c461 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151460 Aug 24 09:37:02.149382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 452/897] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:01 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:02.797537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:02.800322 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:02.806748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:02.807234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:02.807705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:02.808403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:02.808859 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:02.809283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:02.837659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bd4027cd-f362-44cb-adc1-ea8fb7705629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044041 Aug 24 09:37:02.838204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 446/898] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:03.171554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:03.172146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:03.178482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:03.178968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:03.179408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:03.180132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:03.180591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:03.181024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:03.319591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:03.329126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:03.330622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:03.332043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-54a20dc9-1dfc-4532-aa7a-20904b286758 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.164471 Aug 24 09:37:03.332608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 453/899] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:03 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:03.849307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:03.851463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:03.857767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:03.858254 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:03.858688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:03.859907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:03.860361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:03.860779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:03.890744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-16df52e1-6c26-4b38-9fa0-66c57000eddc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045310 Aug 24 09:37:03.891309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 447/900] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:04.355185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:04.356562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:04.364017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:04.364444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:04.364884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:04.365581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:04.366233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:04.367651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:04.504190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:04.512799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:04.514296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:04.515998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b36f687d-7c8f-4661-be07-1dfd92947275 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.164083 Aug 24 09:37:04.516560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 454/901] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:04.903252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:04.905446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:04.907851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=60 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:04.912448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:04.912930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:04.914315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:04.914315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:04.914627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:04.915058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:04.944218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2d40e7ff-3928-4f8e-8fe1-57f5ed46c539 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044982 Aug 24 09:37:04.944760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 448/902] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:05.538255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:05.538871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:05.545524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:05.546005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:05.546441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:05.547753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:05.548208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:05.548632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:05.676288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:05.684809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:05.686313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:05.687493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b8f66ace-8881-4ce6-ad46-f10a4bc39232 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153080 Aug 24 09:37:05.688107 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 455/903] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:05.957004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:05.959089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:05.965696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:05.966174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:05.966614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:05.967302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:05.967791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:05.968213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:05.997580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-86626fd8-988b-4907-9095-b7910a54c8d3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045129 Aug 24 09:37:05.998120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 449/904] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:06.710235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:06.710846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:06.713398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=52 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:06.718125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:06.719189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:06.723418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:06.723418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:06.723418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:06.723418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:06.846827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:06.855416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:06.857011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:06.858160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ffd87908-f6e3-46ee-89e7-2b370c54d189 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151815 Aug 24 09:37:06.858722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 456/905] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:07.009813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:07.011962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:07.018805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:07.019281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:07.019749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:07.020459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:07.020913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:07.021331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:07.050195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e0b1d9c3-5283-49a8-9844-9b642e5dfaf1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Aug 24 09:37:07.050734 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 450/906] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:07.880634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:07.881182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:07.887550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:07.888108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:07.888541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:07.889224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:07.889672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:07.890097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:08.017914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:08.026477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:08.028003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:08.029153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6e312a31-00e2-4da0-8b84-2d8589cf4588 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152482 Aug 24 09:37:08.029710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 457/907] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:07 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:08.062134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:08.064309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:08.070599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:08.072963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:08.072963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:08.072963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:08.072963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:08.073330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:08.102723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e5ce2511-8b20-4d32-9d50-d7e8a3ee0bdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044487 Aug 24 09:37:08.103270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 451/908] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:09.052573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:09.053182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:09.059477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:09.059991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:09.060422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:09.061098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:09.061543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:09.062045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:09.115407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:09.117760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:09.124223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:09.125298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:09.125740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:09.126593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:09.127090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:09.127529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:09.151074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:09.157117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ad2b41e-47a9-4cce-b1c2-cd50fb8a6b8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045692 Aug 24 09:37:09.157682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 452/909] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:09.194760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:09.203234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:09.204751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:09.205885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-214d5610-7433-407b-9305-eb9331938fed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.157244 Aug 24 09:37:09.206437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 458/910] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:09 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:10.169661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:10.171881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:10.178689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:10.179171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:10.179619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:10.180308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:10.180757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:10.181175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:10.210251 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d082c034-8224-4a87-af7e-f5997dc9b68b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044937 Aug 24 09:37:10.210784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 453/911] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:10.228669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:10.229285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:10.235777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:10.236258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:10.236690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:10.237373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:10.237822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:10.238243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:10.242176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:10.365359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:10.373929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:10.378659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:10.378659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-16835963-ecc5-402b-b616-439a9516f0fd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152297 Aug 24 09:37:10.378659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 459/912] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:10 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:11.223255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:11.225412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:11.231701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:11.232178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:11.232613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:11.233289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:11.233847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:11.234270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:11.262107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7fdd96f6-ceb8-4735-b6a9-6185b7446a06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042827 Aug 24 09:37:11.263374 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 454/913] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:11.400293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:11.400924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:11.408144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:11.408634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:11.409075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:11.409847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:11.410304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:11.410730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:11.539786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:11.548360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:11.549863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:11.550989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0ccb0dcc-25f5-4bf5-a9ad-894a73bb43ed tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154717 Aug 24 09:37:11.551539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 460/914] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:11 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:12.275153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:12.277309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:12.284202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:12.284676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:12.285105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:12.285781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:12.286228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:12.286643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:12.317806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b46fabeb-6810-4fb9-8422-d307c1670040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046823 Aug 24 09:37:12.318371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 455/915] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:12.573368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:12.573981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:12.580597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:12.581088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:12.581525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:12.582229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:12.582683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:12.583132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:12.713600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:12.723017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:12.724597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:12.725787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8584cbee-d302-4943-909c-070ef4b1a39b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156319 Aug 24 09:37:12.726341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 461/916] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:13.330783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:13.332963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:13.339741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:13.340230 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:13.340675 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:13.341366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:13.341823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:13.342251 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:13.370504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c16d43de-53e8-4334-98e0-c6fc121a4768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Aug 24 09:37:13.370994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 456/917] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:13.748826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:13.750037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:13.756460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:13.756940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:13.757460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:13.758152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:13.758604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:13.759028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:13.900185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:13.909368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:13.910907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:13.912159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4e5e1be7-eb5b-49dc-8219-f91904188e88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.167258 Aug 24 09:37:13.920438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 462/918] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:37:14.382483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:14.384656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:14.391700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:14.392184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:14.392669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:14.393361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:14.393819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:14.394248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:14.423252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f8c68d84-5bd1-4e2d-808e-40f705d99fe7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044723 Aug 24 09:37:14.423830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 457/919] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:14.933961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:14.934605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:14.940918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:14.941398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:14.941839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:14.942529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:14.942985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:14.943410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:15.077128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:15.086450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:15.087978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:15.089159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fe5e6a19-b1b9-49f4-b199-b788ff12d79f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.159018 Aug 24 09:37:15.089715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 463/920] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:15.435477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:15.438059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:15.444380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:15.444856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:15.445285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:15.445993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:15.446442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:15.446865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:15.475299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-844a7b80-46ec-4541-8d85-04b3bbe3226a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043853 Aug 24 09:37:15.475861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 458/921] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:16.113302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:16.113915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:16.119862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:16.120342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:16.120787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:16.121471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:16.121925 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:16.122349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:16.255077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:16.263628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:16.265149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:16.266298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ceebb484-d531-43af-bb89-a2c5f09f5a10 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.157662 Aug 24 09:37:16.266852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 464/922] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:16 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:16.487564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:16.489747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:16.496142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:16.496622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:16.497059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:16.497748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:16.498201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:16.498625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:16.527306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4c93b41e-d460-4ea0-9035-ee8385f87cea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043645 Aug 24 09:37:16.527848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 459/923] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:17.289359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:17.289971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:17.296803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:17.297314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:17.297756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:17.298447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:17.298903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:17.299325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:17.427000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:17.435546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:17.437668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:17.438807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-528f5058-9f70-4788-a5ca-cc983bfdf084 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153282 Aug 24 09:37:17.439357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 465/924] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:17 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:17.539267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:17.541507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:17.548620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:17.549097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:17.549524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:17.550207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:17.550656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:17.551078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:17.578973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d1a4e27-8394-477e-964a-50106e5985d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043683 Aug 24 09:37:17.579504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 460/925] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:18.461560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:18.462181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:18.468512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:18.469001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:18.469442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:18.470130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:18.470588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:18.471022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:18.590678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:18.592815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:18.596217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:18.599086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:18.599576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:18.600031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:18.600721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:18.601170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:18.601589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:18.604940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:18.606439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:18.607635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8af70b68-c522-458a-a7fc-12d3df080f8f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150235 Aug 24 09:37:18.608191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 466/926] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:18.630652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9fd4d785-12cc-4915-8012-2c3c114e26b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Aug 24 09:37:18.631184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 461/927] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:19.629584 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:19.630195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:19.636699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:19.637162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:19.637598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:19.638287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:19.638743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:19.639164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:19.642784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:19.645053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:19.652121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:19.652732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:19.653174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:19.653885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:19.654345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:19.656010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:19.684366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-544c7f0a-d87f-4224-bab0-adecbcad8a13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045977 Aug 24 09:37:19.684930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 462/928] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:19.770168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:19.778639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:19.780163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:19.781958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-92b1ea40-bb90-423a-a11c-57e395c64cc6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156371 Aug 24 09:37:19.782500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 467/929] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:20.696788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:20.698932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:20.705334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:20.705815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:20.706252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:20.706941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:20.707397 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:20.707862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:20.737975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b49577aa-74d8-4412-b0e8-7abdfd4dfc9c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Aug 24 09:37:20.738536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 463/930] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:20.804096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:20.804704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:20.811016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:20.811546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:20.812026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:20.812713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:20.813169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:20.813589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:20.937292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:20.945900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:20.947549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:20.948673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-311241ad-4f75-4ace-b416-0b0f148a9e40 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.148453 Aug 24 09:37:20.949226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 468/931] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:21.751099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:21.753276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:21.759655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:21.760141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:21.760579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:21.761269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:21.761724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:21.762150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:21.790279 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dddbd92b-179e-4a3f-908a-52e7b7a7e411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Aug 24 09:37:21.790815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 464/932] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:21.972261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:21.972908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:21.979419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:21.979880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:21.980320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:21.981011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:21.981467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:21.981894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:22.111328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:22.119882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:22.121367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:22.122499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-20204db2-6275-4c31-9b14-e2d06ca8a0de tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154189 Aug 24 09:37:22.123055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 469/933] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:21 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:22.802603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:22.804785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:22.811146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:22.812169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:22.812607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:22.813295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:22.813750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:22.814176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:22.843257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1906d14e-70ce-4481-af9c-61155b3c0262 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Aug 24 09:37:22.843827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 465/934] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:23.145589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:23.146121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:23.152457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:23.152941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:23.153377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:23.154060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:23.154513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:23.154937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:23.285167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:23.293646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:23.295150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:23.296824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-87c2982f-c583-41a4-b015-de66de259c38 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155218 Aug 24 09:37:23.297578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 470/935] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:23.854891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:23.857071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:23.864137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:23.864617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:23.865058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:23.865748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:23.866204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:23.866627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:23.895123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-77c9a00a-60bf-4919-981d-e4a0c6f747ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043951 Aug 24 09:37:23.895717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 466/936] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:24.318977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:24.319609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:24.325958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:24.326441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:24.326876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:24.327605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:24.328067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:24.328494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:24.457273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:24.466233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:24.468291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:24.469443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8283c593-861e-46ca-a72c-a76be1ab3703 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154428 Aug 24 09:37:24.469996 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 471/937] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:24 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:24.908168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:24.910383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:24.916842 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:24.917327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:24.917824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:24.918464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:24.918922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:24.919352 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:24.947527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d8e407a9-d57c-45a6-ad03-5e92f2d60895 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Aug 24 09:37:24.948113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 467/938] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:25.493340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:25.493947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:25.500821 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:25.501302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:25.501731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:25.502415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:25.502867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:25.503289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:25.633207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:25.641732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:25.643214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:25.644391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7994322c-174d-4c71-a7ad-a69f29ae31f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154949 Aug 24 09:37:25.644943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 472/939] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:25.959422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:25.961866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:25.968676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:25.969148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:25.969578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:25.970255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:25.970705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:25.971124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:25.999761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-72f849b8-3734-4281-ba0d-ecedb495afae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Aug 24 09:37:26.000300 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 468/940] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:26.666480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:26.667091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:26.673597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:26.674074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:26.674506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:26.675187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:26.675658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:26.676120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:26.800641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:26.809058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:26.810538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:26.812220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-52477be1-f8c1-4141-896f-cf937d6a0e5f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.149687 Aug 24 09:37:26.812770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 473/941] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:27.011883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:27.014088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:27.020669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:27.020971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:27.021405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:27.022091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:27.022547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:27.022972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:27.036334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:27.052230 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-98e3e1d2-8001-48eb-bede-8b0acc05a411 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044403 Aug 24 09:37:27.052776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 469/942] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:27.834501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:27.835030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:27.841635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:27.842117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:27.842554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:27.843244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:27.843721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:27.844150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:27.967880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:27.976352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:27.977860 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:27.979043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2573d95d-d52f-4b4b-8fdf-e65f08b09b66 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.148478 Aug 24 09:37:27.979892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 474/943] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:28.064660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:28.066827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:28.073323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:28.073806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:28.074246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:28.074936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:28.075391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:28.075842 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:28.104650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0f35334f-477b-4022-8308-e3fc20c29031 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Aug 24 09:37:28.105123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 470/944] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:29.001170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:29.001728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:29.008635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:29.009121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:29.013136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:29.013136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:29.013136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:29.013136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:29.117142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:29.119519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:29.126189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:29.126742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:29.127176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:29.127930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:29.128380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:29.129160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:29.148059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:29.150411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:29.158761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:29.160428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:29.161598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9bea752a-1e96-4441-9b88-a87dcf38587b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.164344 Aug 24 09:37:29.168157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 475/945] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:28 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:29.168603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1a811c12-70bd-4282-8489-e1353f145a3b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049099 Aug 24 09:37:29.168603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 471/946] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:30.175054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:30.177240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:30.183827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:30.184312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:30.184750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:30.184998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:30.185438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:30.185615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:30.185890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:30.186372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:30.192612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:30.193096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:30.193538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:30.194231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:30.194693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:30.195122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:30.215641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-992a97be-a780-42c9-a039-6fedc7280179 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045285 Aug 24 09:37:30.216383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 476/947] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:30.324472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:30.333202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:30.334684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:30.335862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-abc36d39-21d9-494f-8ba6-65d5f81634bd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154766 Aug 24 09:37:30.336670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 472/948] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:30 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:37:31.227394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:31.229570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:31.235891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:31.236370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:31.236804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:31.237486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:31.237940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:31.238360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:31.267337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0a0e92fa-53a8-448e-a0d9-b96b041f2177 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043937 Aug 24 09:37:31.267908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 477/949] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:31.358732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:31.359273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:31.365685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:31.366172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:31.366594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:31.367272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:31.367747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:31.368170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:31.496655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:31.505805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:31.507283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:31.508469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f15da3b6-d75a-49f0-85b6-f7d4428000c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153708 Aug 24 09:37:31.509030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 473/950] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:32.279283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:32.281461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:32.287798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:32.288286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:32.288723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:32.289413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:32.289871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:32.290300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:32.321941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-40cce9da-349f-46a8-aeea-d53b3a37e862 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046547 Aug 24 09:37:32.322494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 478/951] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:32.530780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:32.531415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:32.537638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:32.542529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:32.542529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:32.542529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:32.542529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:32.542891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:32.674336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:32.682797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:32.684438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:32.685511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cfda62f5-d183-4efa-97bf-bb34fcc84a47 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.159178 Aug 24 09:37:32.686070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 474/952] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:33.334213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:33.336617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:33.342869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:33.343340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:33.343820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:33.344532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:33.344978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:33.345398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:33.373218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-79b8d3c9-8ff4-478a-a08e-4b640b4c7bed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042953 Aug 24 09:37:33.374269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 479/953] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:33.707676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:33.708290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:33.714952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:33.715636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:33.716080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:33.716769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:33.717227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:33.717652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:33.843960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:33.852588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:33.857601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:33.857601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5d13bb78-0baf-4550-8df3-5eb39f0e5c37 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151462 Aug 24 09:37:33.857601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 475/954] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:34.385948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:34.388136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:34.394511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:34.394985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:34.395417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:34.396155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:34.396602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:34.397022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:34.426202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3dca49e3-ff06-4191-a5c5-70e251a67303 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044170 Aug 24 09:37:34.426734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 480/955] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:34.879521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:34.880183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:34.886654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:34.887133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:34.887566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:34.888304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:34.888754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:34.889752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:35.021432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:35.032474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:35.034210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:35.036402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1bb2e1f8-0bcc-4ccd-b9b4-0ef56b2ef39e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.160795 Aug 24 09:37:35.036947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 476/956] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:34 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:35.438163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:35.440326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:35.446685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:35.447170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:35.447637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:35.448328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:35.448804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:35.449229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:35.477417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c861f00c-d689-4205-b7fa-49813e370f17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Aug 24 09:37:35.477951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 481/957] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:36.058212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:36.058834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:36.060850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=58 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:36.065441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:36.065927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:36.066358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:36.067089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:36.067544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:36.067997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:36.196063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:36.205117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:36.206629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:36.207825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3bcd902a-f675-4e7f-af53-8564c83e45f8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153537 Aug 24 09:37:36.208387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 477/958] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:36 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:36.489939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:36.492149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:36.499006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:36.499491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:36.499958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:36.500652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:36.501105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:36.501527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:36.530548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-361e41b3-3c4a-4110-9aaf-715e86dfdd89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Aug 24 09:37:36.531099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 482/959] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:37.231036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:37.231574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:37.238467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:37.238949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:37.239399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:37.240099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:37.240588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:37.241014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:37.365969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:37.374482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:37.376048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:37.377202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1411eaa1-3a12-4b48-91b6-b145054b3477 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150131 Aug 24 09:37:37.377757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 478/960] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:37 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:37.542479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:37.544640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:37.547000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=54 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:37.551575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:37.552102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:37.552539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:37.553218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:37.558059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:37.558059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:37.583048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ff4743ce-d281-46ef-bbaf-a8c8a3402763 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044592 Aug 24 09:37:37.583665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 483/961] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:38.399614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:38.400233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:38.407111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:38.407618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:38.408061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:38.408757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:38.409215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:38.409644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:38.544715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:38.553302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:38.554836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:38.555966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-805e06b6-6877-4ca7-8f84-e681cd23ea33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.160238 Aug 24 09:37:38.556516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 479/962] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:38 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:38.595608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:38.597758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:38.604110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:38.604595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:38.605035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:38.605728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:38.606183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:38.606610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:38.635231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b8295be3-d8a5-414d-9afb-95fc2f07bce4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043541 Aug 24 09:37:38.635800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 484/963] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:39.579644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:39.580259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:39.587012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:39.587499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:39.587972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:39.588671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:39.589135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:39.589565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:39.647940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:39.650043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:39.656838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:39.657322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:39.657757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:39.658450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:39.658903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:39.659328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:39.689720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a81355de-9a8d-43ea-b8c0-25b155f10f00 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Aug 24 09:37:39.690280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 485/964] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:39.717128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:39.725621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:39.727153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:39.728411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b365ef0-43a4-4d96-bd8b-eeb5ff217432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153322 Aug 24 09:37:39.728964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 480/965] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:40.553818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-54a54d6a-8c66-4f79-9e48-055587a5ecd1 tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] Calling method '.version_select at 0x7fa912e18670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:40.565444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [None req-54a54d6a-8c66-4f79-9e48-055587a5ecd1 tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] [28235ba4-7f52-4936-a5f4-4e3e8bc90f5c] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 09:37:40.701898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:40.704101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:40.710370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:40.710843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:40.711526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:40.712229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:40.712679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:40.713098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:40.741407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f847bbb2-ddb6-4cfd-9dcf-fb672b5b7210 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Aug 24 09:37:40.741943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 481/966] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:40.751557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:40.752170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:40.757801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:40.758278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:40.758711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:40.759396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:40.759875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:40.760302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:40.885641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:40.894240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:40.905051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:40.905051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b9e2ad5f-a014-445d-91cd-8c767f4d74ca tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.149657 Aug 24 09:37:40.905051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 482/967] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:40 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:37:41.569626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [None req-54a54d6a-8c66-4f79-9e48-055587a5ecd1 tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] [28235ba4-7f52-4936-a5f4-4e3e8bc90f5c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 54832. Aug 24 09:37:41.658733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-54a54d6a-8c66-4f79-9e48-055587a5ecd1 tempest-TestShelveInstance-1824967700 tempest-TestShelveInstance-1824967700-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-361727661" status: 202 len: 0 microversion: 2.1 time: 1.109164 Aug 24 09:37:41.659332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 486/968] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 09:37:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-361727661 => generated 0 bytes in 1110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:37:41.753519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:41.755696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:41.761969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:41.762441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:41.762873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:41.763554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:41.764033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:41.764453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:41.797070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9869fbb3-bb35-4b8f-b08e-c6884412938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047445 Aug 24 09:37:41.797630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 483/969] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:41.919853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:41.921176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:41.928220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:41.928708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:41.929137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:41.929831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:41.930278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:41.930697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:42.056656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:42.065296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:42.066797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:42.067974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eed65571-75c2-42d2-be50-d2d84267b055 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152080 Aug 24 09:37:42.068536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 487/970] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:41 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:42.810439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:42.813266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:42.820273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:42.821045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:42.821644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:42.822648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:42.823277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:42.823733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:42.859170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d0d60da5-1302-48e3-afd3-5b4792f41bbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053569 Aug 24 09:37:42.863650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 484/971] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:43.090723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:43.091342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:43.098239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:43.098724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:43.099159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:43.099891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:43.100345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:43.100769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:43.485593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:43.494338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:43.496327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:43.497015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dde1635b-497e-44bf-bd64-799bfb8dff61 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.410274 Aug 24 09:37:43.497770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 488/972] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:43.871528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:43.874930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:43.881985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:43.882758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:43.883390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:43.884314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:43.884945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:43.885542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:43.920041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-18aab30c-2c0a-422b-bfb1-bd58690f9f58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052360 Aug 24 09:37:43.920860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 485/973] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:44.521312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:44.522083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:44.528977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:44.529998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:44.530439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:44.531168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:44.531648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:44.532076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:44.679241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:44.688911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:44.690666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:44.691875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2bb07782-9abf-4cb0-85e4-71fed9ee7ca5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.175701 Aug 24 09:37:44.692874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 489/974] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:44 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:44.933211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:44.935357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:44.942908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:44.943667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:44.944293 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:44.945003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:44.945620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:44.946217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:44.950211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:44.977056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3da829d4-e9a5-4ad2-882d-4a629ae146d4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048176 Aug 24 09:37:44.978175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 486/975] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:45.762838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:45.762838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:45.762838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:45.762838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:45.763827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:45.763827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:45.763827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:45.763827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:45.959917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:45.969101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:45.970640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:45.971833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-417f7a96-ac75-471d-83b5-439e85e1a8f2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.258512 Aug 24 09:37:45.972398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 490/976] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:45.989638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:45.991888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:45.999431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:45.999943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:46.000381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:46.001075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:46.001535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:46.001960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:46.031178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ce8589c6-06dc-420e-87a8-9a67694128f5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Aug 24 09:37:46.035526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 487/977] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:46.995849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:46.996483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:47.002577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:47.003053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:47.003484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:47.004191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:47.004642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:47.005066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:47.043107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:47.046203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:47.052879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:47.053434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:47.053878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:47.054586 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:47.055051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:47.055480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:47.085288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f69825a5-a9c7-4b77-9c75-657fdf4bfbf0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Aug 24 09:37:47.086113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 488/978] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:47.206964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:47.215878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:47.218149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:47.219327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6672882c-e63d-43f0-b606-c0530873a488 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.227441 Aug 24 09:37:47.220107 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 491/979] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:48.097869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:48.100138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:48.106498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:48.106985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:48.107429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:48.108155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:48.108620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:48.109052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:48.139765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bbf02b51-4403-485a-8fc7-8a8b7c98e115 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045964 Aug 24 09:37:48.140315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 489/980] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:48.242077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:48.242711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:48.250095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:48.250591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:48.251233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:48.251977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:48.252608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:48.253043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:48.510521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:48.519591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:48.521104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:48.522253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e0306d8f-6f7d-4ea6-a367-45af55d33d1e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.284176 Aug 24 09:37:48.522805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 492/981] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:48 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:49.152394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:49.154595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:49.161104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:49.161585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:49.162213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:49.162913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:49.163363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:49.163814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:49.194267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e921783c-991b-4334-836a-4f9f346b9a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045780 Aug 24 09:37:49.198734 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 490/982] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:49.545555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:49.546187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:49.553169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:49.553664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:49.554099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:49.555023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:49.555481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:49.555937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:49.570946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:37:49.722880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:49.731272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:49.733373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:49.734523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c9a714ca-ac70-4cc6-8a19-177ea7fac29d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.193613 Aug 24 09:37:49.735069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 493/983] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:49 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:50.206591 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:50.208878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:50.224303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:50.224871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:50.225318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:50.234244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:50.234733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:50.235177 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:50.265231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-df8b8323-64a7-4b58-8717-9e48ce85fe55 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062943 Aug 24 09:37:50.266034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 491/984] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:50.756918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:50.757547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:50.764825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:50.765303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:50.765736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:50.766475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:50.766928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:50.767348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:51.150644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:51.159601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:51.161216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:51.162457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-99e422fb-9760-4081-89ad-1385e36ac72e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.409543 Aug 24 09:37:51.163089 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 494/985] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:50 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:51.278623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:51.280906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:51.287334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:51.287853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:51.288295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:51.288996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:51.289459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:51.289889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:51.319557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ae14cc4-61e3-4acf-b37d-99f22e62938f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044751 Aug 24 09:37:51.320071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 492/986] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:52.185466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:52.186077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:52.192382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:52.192859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:52.193289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:52.193968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:52.194413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:52.194830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:52.324210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:52.332049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:52.333698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:52.334811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:52.335189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:52.336648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3260e494-4096-4fce-92c6-5d4c9624dd33 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155018 Aug 24 09:37:52.337206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 495/987] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:52.342392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:52.342871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:52.343305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:52.344024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:52.344477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:52.344904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:52.373998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d368b2c-65e0-4bf1-930b-6e0e891c9b93 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045782 Aug 24 09:37:52.374554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 493/988] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:53.360063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:53.360674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:53.366960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:53.367439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:53.367918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:53.368603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:53.369055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:53.369479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:53.386118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:53.388582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:53.394829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:53.395416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:53.395887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:53.396588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:53.397048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:53.397481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:53.428185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5509db22-0790-48fe-b2a8-9c09561b0716 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045971 Aug 24 09:37:53.428757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 494/989] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:53.498445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:53.506970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:53.508486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:53.509640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cae16630-6662-4c5b-b401-d0bac0ab0ea2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154028 Aug 24 09:37:53.511056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 496/990] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:53 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:54.440570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:54.443289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:54.449708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:54.450194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:54.450663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:54.451359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:54.451846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:54.452277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:54.480621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e4beed84-8eae-48e8-9492-a137b2560354 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Aug 24 09:37:54.481160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 495/991] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:54.532477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:54.533135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:54.539404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:54.539926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:54.540373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:54.541066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:54.541524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:54.541955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:54.667051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:54.676064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:54.677557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:54.678712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a54a6a1a-e5fb-4635-96a4-34adfff5de91 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150110 Aug 24 09:37:54.679263 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 497/992] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:55.493611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:55.495773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:55.502237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:55.502716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:55.503151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:55.503868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:55.504324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:55.504749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:55.534286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6a104086-154a-45ea-893b-56f88d588821 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044655 Aug 24 09:37:55.534831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 496/993] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:55.702059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:55.702668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:55.709009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:55.712205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:55.712205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:55.712205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:55.712205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:55.712716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:55.839154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:55.847686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:55.849189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:55.850373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fddfb0c5-df51-4b3e-83d4-6f7a19a5cdc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152746 Aug 24 09:37:55.850932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 498/994] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:55 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:56.135447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:56.135973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:56.141829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:56.142305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:56.142743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:56.143427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:56.143910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:56.144331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:56.423520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lazy-loading 'services' on Instance uuid fca9f952-e8e8-425b-9f7b-cc3132ad26ce {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:37:56.546239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:56.548428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:56.554420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:56.554893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:56.555323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:56.556034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:56.556482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:56.556901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:56.586523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25b54155-c7dd-4c64-8d60-db2f35c192ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043897 Aug 24 09:37:56.587071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 499/995] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:37:56.661760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ac380834-42f6-40a2-bb0b-487693b2fb85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce/os-volume_attachments/2d004b1e-0f53-4d5e-80dc-8d12597edb13" status: 202 len: 0 microversion: 2.1 time: 0.530133 Aug 24 09:37:56.662384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 497/996] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Aug 24 09:37:56 2022] DELETE /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce/os-volume_attachments/2d004b1e-0f53-4d5e-80dc-8d12597edb13 => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:37:56.872628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:56.873840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:56.880105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:56.880581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:56.881050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:56.881732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:56.882185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:56.882605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:57.009541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:57.018171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:57.019697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:57.020915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1c54061f-a937-498c-bc88-13d052c40b93 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152174 Aug 24 09:37:57.021479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 500/997] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:57.600039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:57.602260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:57.608342 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:57.608819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:57.609252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:57.609932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:57.610381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:57.610806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:57.640090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-87dc93bc-3dfe-447c-881e-ef64ed8ee6f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044860 Aug 24 09:37:57.640629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 498/998] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:58.043883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:58.044492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:58.051056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:58.051564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:58.052385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:58.052711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:58.053168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:58.053594 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:58.183573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:58.192712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:58.194196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:58.195342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-69ed6bfe-88bf-4fc2-ae52-9b1072143940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155384 Aug 24 09:37:58.195926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 501/999] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:58.652306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:58.655463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:58.661830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:58.662307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:58.662741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:58.663420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:58.663903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:58.664326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:58.702437 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-667cf824-c2c4-4537-a930-37fcfa7327cb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054105 Aug 24 09:37:58.702999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 499/1000] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:37:59.218533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:59.219140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:59.225672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:59.226154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:59.226593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:59.227338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:59.227870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:59.228289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:59.358044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:59.366644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:59.368158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:37:59.369297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1dd1077d-9b86-4122-9921-79ea1c93bfd4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155337 Aug 24 09:37:59.369850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 502/1001] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:37:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:37:59.715014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:37:59.717253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:37:59.723676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:59.724191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:59.724651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:59.725334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:37:59.725785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:37:59.726208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:37:59.755191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7cb912dd-8318-4bcf-9b3b-58db0e1c924c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044352 Aug 24 09:37:59.755762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 500/1002] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:37:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:00.393164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:00.393923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:00.400225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:00.400698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:00.401131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:00.401814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:00.402261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:00.402729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:00.530887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:00.539389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:00.540911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:00.542053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-52b9c2a8-5fdf-4900-b984-0b0241b6e167 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153837 Aug 24 09:38:00.542609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 503/1003] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:00.892847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:00.895170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:00.901387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:00.901936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:00.902385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:00.904749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:00.904749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:00.904749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:00.934553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ec3c90c0-e67f-425d-b29d-75291bde938c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.171356 Aug 24 09:38:00.935119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 501/1004] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:01.564767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:01.565410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:01.571785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:01.572264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:01.572697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:01.573379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:01.573833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:01.574258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:01.700749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:01.709413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:01.711190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:01.712446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d72b82cc-8c93-4305-9a88-f2410fa52335 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151503 Aug 24 09:38:01.712999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 504/1005] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:01 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:01.946540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:01.948634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:01.955859 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:01.956344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:01.956781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:01.957470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:01.957926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:01.958349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:01.962660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:01.988200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f6066e82-eabb-4734-b9fe-0b23854e7ab5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Aug 24 09:38:01.988752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 502/1006] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:02.775568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:02.775568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:02.775568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:02.775568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:02.776351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:02.776351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:02.776351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:02.776351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:02.878480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:02.884122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:02.885654 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:02.886806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bcf6f9b2-c0b4-44cb-9e63-b3af3dcb966f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156199 Aug 24 09:38:02.887351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 505/1007] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:03.001295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:03.003391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:03.010493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.010974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.011413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.012141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.012599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.013021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.044616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a7f356de-ebe2-4a90-8a20-3c7bdeff70a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047314 Aug 24 09:38:03.045184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 503/1008] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:03.480491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:03.480991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:03.487315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.487850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.488291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.488973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.489429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.489856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.514047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:38:03.809368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fa96fe1e-7a5e-4d87-8c2c-61de3cb662df tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 204 len: 0 microversion: 2.1 time: 0.332539 Aug 24 09:38:03.810052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 506/1009] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:38:03 2022] DELETE /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:38:03.819510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:03.820154 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:03.826725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.827201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.827650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.828336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.828819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.829237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.911405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:03.912132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:03.918189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.918677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.919113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.920549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:03.927071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:03.927071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:03.957894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:03.965996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7a56d3bd-6e41-4cdd-a2f3-0c98231d7ca1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1670 microversion: 2.1 time: 0.151474 Aug 24 09:38:03.966560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 504/1010] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:03 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:04.052392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:04.056807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:04.059051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:04.061246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:04.062767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:04.063976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-be6cf3ff-c7a5-4f0f-aeeb-b1140c033fa8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156839 Aug 24 09:38:04.064528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 507/1011] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:03 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:04.065495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:04.065980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:04.066410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:04.067098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:04.067547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:04.068005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:04.097839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-70a05755-a5d7-45fb-8c1b-84f5adecb410 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044815 Aug 24 09:38:04.098391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 505/1012] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:04.986780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:04.987401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:04.993761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:04.994248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:04.994690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:04.995393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:04.995881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:04.996314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:05.014205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:05.086376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:05.093468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:05.102105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:05.103658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:05.104336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:05.105528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:05.106223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:05.107054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:05.139560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:05.147844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a449a47c-bfa1-48e7-93c1-2f5c1bbc1327 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1670 microversion: 2.1 time: 0.165318 Aug 24 09:38:05.149000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 508/1013] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:04 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:05.154912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:05.157642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:05.163721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:05.164434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:05.165054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:05.166573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:05.167201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:05.167820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:05.202798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3fc77ce9-5233-452a-b3c1-5c31603721f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052474 Aug 24 09:38:05.208291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 509/1014] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:05.305084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:05.314441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:05.316274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:05.317523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cd632a44-7e0f-482e-a872-e8b34179a5b3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.235269 Aug 24 09:38:05.318278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 506/1015] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:05.729960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-bc237557-dd42-4046-b9b5-4a77dbd655bd req-0cc510ea-efb9-4e7a-97f4-7a391321df15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c65cee-4bde-44b8-844d-9f4a6aac5208", "name": "network-vif-deleted", "tag": "b54629e7-4228-4772-903b-0ba66d767332"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:38:05.739255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-bc237557-dd42-4046-b9b5-4a77dbd655bd req-0cc510ea-efb9-4e7a-97f4-7a391321df15 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:05.739779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-bc237557-dd42-4046-b9b5-4a77dbd655bd req-0cc510ea-efb9-4e7a-97f4-7a391321df15 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:05.740242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-bc237557-dd42-4046-b9b5-4a77dbd655bd req-0cc510ea-efb9-4e7a-97f4-7a391321df15 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:05.751953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-bc237557-dd42-4046-b9b5-4a77dbd655bd req-0cc510ea-efb9-4e7a-97f4-7a391321df15 service nova] Creating event network-vif-deleted:b54629e7-4228-4772-903b-0ba66d767332 for instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 on hv-cinder-85032 Aug 24 09:38:05.757356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-bc237557-dd42-4046-b9b5-4a77dbd655bd req-0cc510ea-efb9-4e7a-97f4-7a391321df15 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031008 Aug 24 09:38:05.758049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 510/1016] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:06.170632 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:06.176057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:06.176057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=60 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:06.179186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:06.179810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:06.180330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:06.181036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:06.181516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:06.181951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:06.214447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:06.214937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:06.215374 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:06.215847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lazy-loading 'fault' on Instance uuid 25c65cee-4bde-44b8-844d-9f4a6aac5208 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:38:06.217107 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:06.220961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:06.234349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:06.234349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:06.234349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:06.240646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:06.241203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:06.241666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:06.278763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:06.290467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9b11a5c9-1b16-48d0-8718-06d3de81f3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079158 Aug 24 09:38:06.291036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 511/1017] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:06.292676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-82d33dc6-13ef-476f-81a5-6107740d011f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 200 len: 1325 microversion: 2.1 time: 0.125823 Aug 24 09:38:06.302220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 507/1018] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:06 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 1325 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:06.341475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:06.342762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:06.349540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:06.350102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:06.350613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:06.351385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:06.351955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:06.352479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:06.489635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:06.500015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:06.501743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:06.508104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6a86a054-fea0-4e99-8b0d-f1c1d81b842b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.170478 Aug 24 09:38:06.508721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 512/1019] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:07.303297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:07.305500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:07.313622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:07.314108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:07.314581 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:07.315405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:07.315772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:07.316155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:07.316616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:07.317518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:07.323039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:07.323805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:07.324442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:07.325186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:07.325816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:07.326948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:07.341566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] HTTP exception thrown: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Request method failure captured: Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 HTTP/1.1 Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8pD5JntjOIDel1FeefqltliRCbc8jhDmwpoJ1AGKlrql1sjCNop2osA4DN5R4KVIwhGobez73bk65_QS0kIbmkcsDbH8aAGj1kd_YA8kK_j-0PdbnMb-Gl4ASuHbIUnzuFdEnJ-YfoQRPZD7dV4T_DgsVXyzpeBBYJTAg0vidot_8 Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:38:07.343739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803ce13612e0460682ef8b4d42781a99", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: b9099dc3ad92431cbac98f144690038c Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:38:07.345169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '25c65cee-4bde-44b8-844d-9f4a6aac5208'} Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:38:07.346001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:38:07.347266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:38:07.348454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Returning 404 to user: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:38:07.348454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f9c967be-8958-4971-b4e0-cf81305b8fc3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 404 len: 111 microversion: 2.1 time: 0.034909 Aug 24 09:38:07.348454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 513/1020] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:07 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:38:07.353718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-09e5e19e-c458-4338-9563-538d570d79f7 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '.version_select at 0x7fa912e711f0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:07.359991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-84db5fba-b431-4153-b523-babf7e42923d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060495 Aug 24 09:38:07.360886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 508/1021] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:07.458033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-09e5e19e-c458-4338-9563-538d570d79f7 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-38152476" status: 202 len: 0 microversion: 2.1 time: 0.107821 Aug 24 09:38:07.458601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 514/1022] 10.222.0.16 () {58 vars in 1215 bytes} [Wed Aug 24 09:38:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-38152476 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:38:07.670314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:07.670935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:07.677748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:07.678453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:07.678886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:07.679636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:07.680248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:07.680670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:07.819569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:07.829068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:07.830571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:07.831768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-77ffb9db-5f6b-4dea-a816-c9c30d7b900d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.299328 Aug 24 09:38:07.832468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 509/1023] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:07 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:08.291143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b502c931-1f6d-4f62-a28c-2cce18099cf8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Action: 'create', calling method: .version_select at 0x7fa912dc9040>, body: {"keypair": {"name": "tempest-keypair-1941069782", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKSRVglMde42gib9Vk3qt7zLEjeZOJug5Fc4G8/3641WTOCuFWx+jIwGumuGlOhq6idey5gZ/xts6uHV7UWbm6sN0mK0ofv6zIh8jTZxeVk3cWDfCrghyyFL9mbJA6QWqg=="}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:38:08.297213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:08.313136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-b502c931-1f6d-4f62-a28c-2cce18099cf8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for project 803ce13612e0460682ef8b4d42781a99. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:38:08.313136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-b502c931-1f6d-4f62-a28c-2cce18099cf8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for user b9099dc3ad92431cbac98f144690038c and project 803ce13612e0460682ef8b4d42781a99. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:38:08.372430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:08.374766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:08.381489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:08.388672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:08.388672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:08.388672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:08.388672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:08.389361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:08.410783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b502c931-1f6d-4f62-a28c-2cce18099cf8 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.123502 Aug 24 09:38:08.411373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 515/1024] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 09:38:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:08.436088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d8d88361-9b46-4af0-86aa-a5e649741540 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058111 Aug 24 09:38:08.436088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 510/1025] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:08.859414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:08.860474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:08.869756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:08.870243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:08.870686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:08.871698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:08.871967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:08.872396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:09.001028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:09.011122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:09.017197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:09.019399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-71399a12-128a-41e1-b08a-3d53519f69f1 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.168316 Aug 24 09:38:09.020419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 516/1026] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:08 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:09.438372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:09.440620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:09.447048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:09.447540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:09.448019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:09.448909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:09.449378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:09.449808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:09.481781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5670193a-dfb1-4b67-b1da-9edd5ad75e67 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047310 Aug 24 09:38:09.482337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 511/1027] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:10.042836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:10.043429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:10.050420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:10.050894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:10.051329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:10.052045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:10.052500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:10.052923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:10.065921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:38:10.066178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:38:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:38:10.201554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:10.221979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:10.221979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:10.221979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c7dc2350-7510-4712-a12f-80363618f132 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.175198 Aug 24 09:38:10.222340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 517/1028] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:10 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:10.493337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:10.495441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:10.502768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:10.503485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:10.503992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:10.504629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:10.505370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:10.505858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:10.538648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-896afbe9-f21f-4986-b8b9-55190c83767a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049315 Aug 24 09:38:10.539192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 512/1029] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:10.816272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1701075657", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f82ab4fe-0b45-4012-bd34-d0cceb1c3651"}], "security_groups": [{"name": "tempest-securitygroup--929805118"}], "key_name": "tempest-keypair-1941069782", "user_data": "}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:38:10.925575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] validate_networks() for [('f82ab4fe-0b45-4012-bd34-d0cceb1c3651', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:38:10.937416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:38:10.937629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:38:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.16) !!! Aug 24 09:38:11.242485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:11.243120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:11.249750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:11.250231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:11.250663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:11.251348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:11.251892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:11.252317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:11.354415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:38:11.355430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:38:11.355934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:38:11.356339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:38:11.356748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:38:11.367067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:11.367543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:11.368037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:11.368780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:11.369206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:11.369624 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:11.385862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for project 803ce13612e0460682ef8b4d42781a99. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:38:11.386405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:11.389744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Getting quotas for user b9099dc3ad92431cbac98f144690038c and project 803ce13612e0460682ef8b4d42781a99. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:38:11.395047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:11.396784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:11.397938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e67bb039-f922-4931-b83c-2f6602f9691b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.159399 Aug 24 09:38:11.398487 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 513/1030] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:11 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:11.400508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:38:11.402781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:38:11.505533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-10436588-4024-4b1e-95b1-1fe538c9c513 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.693563 Aug 24 09:38:11.506229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 518/1031] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:38:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:38:11.516784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-95fd4d2e-7673-4175-828b-4e5718d56c85 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:11.517528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-95fd4d2e-7673-4175-828b-4e5718d56c85 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:11.551418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:11.553849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:11.562427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:11.562987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:11.563514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:11.564308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:11.564891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:11.565525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:11.586633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-95fd4d2e-7673-4175-828b-4e5718d56c85 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:11.595781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-95fd4d2e-7673-4175-828b-4e5718d56c85 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1238 microversion: 2.1 time: 0.082689 Aug 24 09:38:11.596920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 514/1032] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:11 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1238 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:11.600389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-77d38d50-efa0-4bab-b515-cb0e29f149fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053416 Aug 24 09:38:11.606303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 519/1033] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:12.420997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:12.421600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:12.428351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:12.428840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:12.429269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:12.429955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:12.430406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:12.430829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:12.564763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:12.573442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:12.574935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:12.576153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0544c8b8-40e0-4783-847d-583c31fdbb98 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.159626 Aug 24 09:38:12.576708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 515/1034] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:12.614202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:12.616283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:12.616688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:12.616891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:12.623366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:12.623718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:12.623899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:12.624203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:12.624323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:12.624642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:12.625020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:12.625339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:12.625454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:12.625842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:12.625967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:12.626271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:12.668015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1ffdbae1-ebd5-4d15-99a3-d19a11e4e847 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056540 Aug 24 09:38:12.668800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 520/1035] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:12.694724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:12.707764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-05288be1-3cdd-4d30-9676-7a237700e404 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1242 microversion: 2.1 time: 0.090018 Aug 24 09:38:12.715999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 516/1036] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:12 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1242 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:38:13.598538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:13.599151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:13.605355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:13.606475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:13.607360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:13.608101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:13.608549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:13.608967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:13.681718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:13.683926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:13.693007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:13.693501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:13.693942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:13.694956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:13.695424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:13.695893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:13.734391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fa21a24f-8ea6-46b4-9f28-6888b9eff84f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056528 Aug 24 09:38:13.735366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 517/1037] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:13.740133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:13.740973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:13.747150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:13.750384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:13.751037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:13.752849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:13.753254 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:13.753853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:13.765035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:13.774841 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:13.777479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:13.778700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7d2e0135-a8a4-41e5-ab6b-b01b6db1c474 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.184299 Aug 24 09:38:13.788617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 521/1038] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:13.834459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:13.842253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bb3817a0-d0a2-4cf1-820c-cec0e95faf23 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1298 microversion: 2.1 time: 0.105674 Aug 24 09:38:13.843010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 518/1039] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:13 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:14.746415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:14.749169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:14.756068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:14.756563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:14.757006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:14.757854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:14.758359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:14.758794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:14.789137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3567f55b-938e-4322-9fd9-87595dac2b03 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046619 Aug 24 09:38:14.789751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 522/1040] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:14.802041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:14.802649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:14.809759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:14.810781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:14.811226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:14.811997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:14.812481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:14.812943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:14.833383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:14.863224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:14.863879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:14.870036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:14.870523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:14.870955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:14.871880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:14.872535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:14.873748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:15.027188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:15.035672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-55ff7133-be74-4b34-a3ba-a026211889d3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.176200 Aug 24 09:38:15.036238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 523/1041] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:14 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:38:15.084696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:15.094872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:15.096421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:15.097597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8eb7b2d9-b1a0-4eb7-bb6e-6c71fea8a22c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.299773 Aug 24 09:38:15.098161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 519/1042] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:14 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:15.643799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-55284433-5ea6-42c6-bfb8-cf1ea1585a40 req-5d18e987-3a29-443e-b5fd-a658c64fd702 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7384e8a-d236-4e15-9dbf-6caf3034ceee", "tag": "1aa841b8-3b02-4af0-bda2-a161690e08a2"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:38:15.653274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-55284433-5ea6-42c6-bfb8-cf1ea1585a40 req-5d18e987-3a29-443e-b5fd-a658c64fd702 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:15.653847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-55284433-5ea6-42c6-bfb8-cf1ea1585a40 req-5d18e987-3a29-443e-b5fd-a658c64fd702 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:15.654807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-55284433-5ea6-42c6-bfb8-cf1ea1585a40 req-5d18e987-3a29-443e-b5fd-a658c64fd702 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:15.665871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-55284433-5ea6-42c6-bfb8-cf1ea1585a40 req-5d18e987-3a29-443e-b5fd-a658c64fd702 service nova] Creating event network-changed:1aa841b8-3b02-4af0-bda2-a161690e08a2 for instance b7384e8a-d236-4e15-9dbf-6caf3034ceee on hv-cinder-85032 Aug 24 09:38:15.670855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-55284433-5ea6-42c6-bfb8-cf1ea1585a40 req-5d18e987-3a29-443e-b5fd-a658c64fd702 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030874 Aug 24 09:38:15.671642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 524/1043] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:15.801695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:15.803942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:15.810831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:15.811316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:15.811812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:15.812508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:15.812963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:15.813387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:15.843919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a3253323-a21b-4434-8d21-b793a28b0682 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046289 Aug 24 09:38:15.844522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 520/1044] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:16.059860 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:16.061196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:16.067406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:16.068007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:16.068541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:16.069312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:16.069846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:16.070344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:16.121609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:16.122324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:16.129480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:16.130677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:16.131252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:16.131993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:16.132536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:16.133020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:16.205413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:16.213432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-edb02b45-5b9e-4c5c-a98c-e391c6f8939d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.158344 Aug 24 09:38:16.214003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 525/1045] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:16 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:16.334803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:16.343782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:16.345386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:16.346629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fe462155-3bd5-471b-8e6b-6b23191d3522 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.229200 Aug 24 09:38:16.347269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 521/1046] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:16 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:16.855406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:16.858413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:16.864361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:16.866083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:16.866083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:16.866083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:16.866463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:16.866893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:16.895938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4e5312bf-7f42-46be-9b94-06d5e045867a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044602 Aug 24 09:38:16.896491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 526/1047] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:17.233816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:17.234347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:17.240683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:17.241163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:17.241598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:17.242289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:17.242747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:17.243173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:17.373724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:17.375032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:17.382164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:17.382685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:17.383124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:17.383859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:17.383975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:17.384458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:17.384894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:17.392156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-96242817-e190-478c-96ed-132fc97b1d5d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.162279 Aug 24 09:38:17.392713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 522/1048] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:17 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:17.511901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:17.521269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:17.522826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:17.523999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b7092545-4116-4527-b890-83da20d17c24 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.158084 Aug 24 09:38:17.524549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 527/1049] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:17 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:17.908145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:17.910308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:17.916298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:17.916782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:17.917223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:17.917918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:17.918379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:17.918916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:17.948148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c4e0b4a0-ebfd-46bc-96b8-f121223c7507 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043980 Aug 24 09:38:17.948699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 523/1050] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:18.412292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:18.412903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:18.419158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:18.419663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:18.420100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:18.420779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:18.421226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:18.421648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:18.546127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:18.546748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:18.550635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:18.553415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:18.553870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:18.554258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:18.554967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:18.555427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:18.555882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:18.559306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8a6d7aa7-4f8e-493a-87bd-b204f77f0d61 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.150751 Aug 24 09:38:18.560108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 528/1051] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:18 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:18.686067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:18.694752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:18.696299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:18.697520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8f1835a4-06a8-46e3-98ee-e638e884aa76 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155241 Aug 24 09:38:18.703892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 524/1052] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:18.960247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:18.962727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:18.968734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:18.969220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:18.969671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:18.970362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:18.970819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:18.971248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:18.996791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:19.001971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-30255324-aea5-491d-aa80-b85fbda91e74 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045992 Aug 24 09:38:19.002535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 529/1053] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:19.579654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:19.580178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:19.586787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:19.587270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:19.587745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:19.588438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:19.588895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:19.589323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:19.720247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:19.725182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:19.725802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:19.728427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d3004628-643a-4225-9d25-2eab1b3a7c0d tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.152625 Aug 24 09:38:19.735669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 525/1054] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:19 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:19.735854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:19.735854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:19.735854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:19.735854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:19.736186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:19.736186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:19.867117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:19.875787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:19.877284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:19.878434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0725a636-c04c-479c-960b-d16e56883fc0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.157194 Aug 24 09:38:19.878993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 530/1055] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:20.014902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:20.017128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:20.023012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:20.023497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:20.023996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:20.024687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:20.025144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:20.025571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:20.056221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a41d4648-d9ec-4b3e-80e5-d1ecb63dacb4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045804 Aug 24 09:38:20.056761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 526/1056] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:20.751059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:20.751607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:20.757902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:20.758376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:20.758805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:20.759498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:20.759975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:20.760395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:20.891269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:20.898905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-09851203-a21e-43c7-a15f-d727b8e85015 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.152459 Aug 24 09:38:20.899460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 531/1057] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:20 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:20.901242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:20.901881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:20.908202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:20.908702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:20.909135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:20.909814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:20.910265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:20.910687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:21.039563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:21.048712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:21.050212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:21.051367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8c1e2e58-702a-40c5-a107-332b217ea548 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153965 Aug 24 09:38:21.051959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 527/1058] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:21.068542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:21.070723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:21.076596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:21.077082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:21.077522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:21.078217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:21.078673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:21.079102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:21.118845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3c3d4637-b1f9-406e-a9d9-710e8915da72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054229 Aug 24 09:38:21.119403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 532/1059] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:21.919256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:21.919894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:21.921762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:21.927110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:21.927711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:21.928044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:21.928815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:21.929269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:21.929776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:21.938177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:21.945703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=10 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:22.000316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-8809d3c3-fdb0-48db-9fc7-90e375960cd3 req-053a96d9-deb4-42aa-a91f-bba815867a21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7384e8a-d236-4e15-9dbf-6caf3034ceee", "name": "network-vif-plugged", "status": "completed", "tag": "1aa841b8-3b02-4af0-bda2-a161690e08a2"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:38:22.009973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8809d3c3-fdb0-48db-9fc7-90e375960cd3 req-053a96d9-deb4-42aa-a91f-bba815867a21 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:22.011136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8809d3c3-fdb0-48db-9fc7-90e375960cd3 req-053a96d9-deb4-42aa-a91f-bba815867a21 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:22.011136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-8809d3c3-fdb0-48db-9fc7-90e375960cd3 req-053a96d9-deb4-42aa-a91f-bba815867a21 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:22.022781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-8809d3c3-fdb0-48db-9fc7-90e375960cd3 req-053a96d9-deb4-42aa-a91f-bba815867a21 service nova] Creating event network-vif-plugged:1aa841b8-3b02-4af0-bda2-a161690e08a2 for instance b7384e8a-d236-4e15-9dbf-6caf3034ceee on hv-cinder-85032 Aug 24 09:38:22.027873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-8809d3c3-fdb0-48db-9fc7-90e375960cd3 req-053a96d9-deb4-42aa-a91f-bba815867a21 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095113 Aug 24 09:38:22.028588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 533/1060] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:22.061905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:22.069691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c72ef95f-b914-436e-96eb-79dfdf2049c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.154271 Aug 24 09:38:22.070397 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 528/1061] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:21 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:22.074645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:22.075433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:22.082146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:22.082639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:22.083081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:22.083815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:22.084325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:22.084763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:22.130878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:22.133105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:22.139511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:22.140039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:22.140480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:22.141182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:22.141637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:22.142061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:22.172294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5880dc8a-526b-45fa-8581-66df188d7f63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045209 Aug 24 09:38:22.173270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 529/1062] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:22.223020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:22.229403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:22.230896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:22.232839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-87d7765b-bfe6-4eaa-997f-98a6e5d08f67 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.162484 Aug 24 09:38:22.233398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 534/1063] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:23.092745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:23.099844 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:23.099844 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:23.100365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:23.100806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:23.101488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:23.101938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:23.102357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:23.184761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:23.187568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:23.194239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:23.194727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:23.195166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:23.195890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:23.196350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:23.196780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:23.228628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-16e6bf07-6193-4032-a688-90cdae70908d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048021 Aug 24 09:38:23.229191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 535/1064] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:23.233100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:23.240853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d22fdc20-0e34-4e59-881c-fe3f6a729bde tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.152021 Aug 24 09:38:23.241404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 530/1065] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:23 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:23.256035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:23.256650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:23.262444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:23.262984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:23.263427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:23.264156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:23.264612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:23.265040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:23.398138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:23.410463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:23.411997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:23.413163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-78a0c010-db24-4319-95a7-d27b19e64360 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.160952 Aug 24 09:38:23.413757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 536/1066] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:24.241391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:24.243523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:24.250609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:24.250863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:24.251266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:24.251986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:24.252439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:24.252861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:24.261663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:24.262273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:24.269217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:24.269696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:24.270128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:24.270814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:24.271261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:24.271709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:24.282635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4c7f767b-34c7-4ff5-beb4-1f5873893e37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Aug 24 09:38:24.285077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 531/1067] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:24.401299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:24.409002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9211ed8f-68b2-4ba7-a07b-e324ebdf37ea tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1363 microversion: 2.1 time: 0.151268 Aug 24 09:38:24.409572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 537/1068] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:24 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:38:24.437229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:24.437945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:24.444064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:24.444636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:24.445135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:24.445927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:24.446446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:24.446937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:24.576387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:24.585054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:24.586829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:24.588014 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a93020f5-038d-432a-a150-a1dc3cde6881 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155492 Aug 24 09:38:24.588562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 532/1069] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:24 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:25.294457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:25.296724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:25.303164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.303671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.304336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.304778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.305255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.305676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.334781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6eacf499-1543-4caa-9c27-e08f5da5ad02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044257 Aug 24 09:38:25.335338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 538/1070] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:25.430189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:25.431610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:25.437860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.438347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.438786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.439495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.439989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.440422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.582380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:25.590255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9d23bf22-63c8-4ef8-9c75-8cd602832993 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1548 microversion: 2.1 time: 0.164146 Aug 24 09:38:25.590820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 533/1071] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:38:25 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:38:25.609772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:25.609964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:25.610383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:25.610501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:25.616289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.616429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.616772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.616880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.617231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.617391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.617979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.618232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:25.618435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.618694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:25.618859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.619123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:25.695325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-00f1deb4-1a3d-41ff-a58f-f169c93c6b2f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089274 Aug 24 09:38:25.696219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 539/1072] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Aug 24 09:38:25 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:25.746903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:25.756088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:25.758108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:25.758761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-94ecfab6-c76f-4879-bc25-8ebc6fed9853 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152616 Aug 24 09:38:25.759498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 534/1073] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:26.347705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:26.349885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:26.356083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:26.357212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:26.357651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:26.358352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:26.358800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:26.359220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:26.390186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ddb82347-e898-4321-b33b-f3a83c6b3ff7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046977 Aug 24 09:38:26.390765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 540/1074] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:26.784443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:26.785067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:26.791822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:26.792308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:26.792744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:26.793490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:26.793943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:26.794367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:26.927568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-c8a211d4-0a5f-4b9a-bb0c-56dc0e745877 req-2f34733a-92d2-4c50-b660-69d4a49d57cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7384e8a-d236-4e15-9dbf-6caf3034ceee", "tag": "1aa841b8-3b02-4af0-bda2-a161690e08a2"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:38:26.937581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-c8a211d4-0a5f-4b9a-bb0c-56dc0e745877 req-2f34733a-92d2-4c50-b660-69d4a49d57cf service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:26.938066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-c8a211d4-0a5f-4b9a-bb0c-56dc0e745877 req-2f34733a-92d2-4c50-b660-69d4a49d57cf service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:26.938497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-c8a211d4-0a5f-4b9a-bb0c-56dc0e745877 req-2f34733a-92d2-4c50-b660-69d4a49d57cf service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:26.940464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:26.951612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:26.952743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-c8a211d4-0a5f-4b9a-bb0c-56dc0e745877 req-2f34733a-92d2-4c50-b660-69d4a49d57cf service nova] Creating event network-changed:1aa841b8-3b02-4af0-bda2-a161690e08a2 for instance b7384e8a-d236-4e15-9dbf-6caf3034ceee on hv-cinder-85032 Aug 24 09:38:26.953657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:26.955528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4a5cfaea-5c41-42dc-ae34-ae3d49ff3117 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.174803 Aug 24 09:38:26.956850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 535/1075] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:26.957752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-c8a211d4-0a5f-4b9a-bb0c-56dc0e745877 req-2f34733a-92d2-4c50-b660-69d4a49d57cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088105 Aug 24 09:38:26.958424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 541/1076] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:38:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:27.402698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:27.405533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:27.411466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:27.412080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:27.412611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:27.413379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:27.413983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:27.414413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:27.418611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:27.453750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4682b734-a1df-48ac-b27e-9cc4c054f146 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054184 Aug 24 09:38:27.453750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 536/1077] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:27.979870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:27.980576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:27.987730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:27.988334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:27.988643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:27.989343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:27.989798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:27.990231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:28.127174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:28.135983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:28.137530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:28.139238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a664a604-c6d7-4fad-b83c-e7037abfdc43 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.164304 Aug 24 09:38:28.139837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 542/1078] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:28.465616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:28.468339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:28.474819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:28.475303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:28.475772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:28.476457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:28.476912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:28.477340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:28.505233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a0dd104e-1140-4567-b625-9ab3344f4266 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044204 Aug 24 09:38:28.505779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 537/1079] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:29.161352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:29.161969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:29.168565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:29.169051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:29.169489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:29.170179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:29.170638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:29.171064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:29.299229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:29.307913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:29.309956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:29.311139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1767b32c-bc34-4a4f-a674-d9336d9399d3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153744 Aug 24 09:38:29.311669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 543/1080] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:29 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:29.517261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:29.520081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:29.526425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:29.526904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:29.527339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:29.528063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:29.528590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:29.529015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:29.557063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6fe91a94-3f1a-4edf-bda1-ec4abed139fa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Aug 24 09:38:29.557600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 538/1081] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:30.334091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:30.334701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:30.341855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:30.342333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:30.342778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:30.343464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:30.343973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:30.344398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:30.470449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:30.478985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:30.480516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:30.481689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1dc13f18-8786-4bef-9f74-e41180067b13 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151484 Aug 24 09:38:30.482240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 544/1082] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:30 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:30.569061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:30.571255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:30.578207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:30.578682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:30.579112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:30.579820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:30.580272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:30.580691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:30.609780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-276f0d62-210d-43c0-b3c9-ec8273fdb664 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044800 Aug 24 09:38:30.610318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 539/1083] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:31.504109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:31.504638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:31.510941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:31.511419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:31.511893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:31.512604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:31.513060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:31.513482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:31.622529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:31.624971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:31.631256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:31.631784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:31.632222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:31.632908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:31.633359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:31.633778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:31.637619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:31.646120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:31.647692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:31.648853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b6f0c9d2-ce2f-4429-9eb4-da541a47c596 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.148704 Aug 24 09:38:31.649407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 545/1084] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:31.663074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d2642712-2d37-4e56-b6fb-71e96a0b4711 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044820 Aug 24 09:38:31.663634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 540/1085] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:32.673006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:32.673630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:32.674881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:32.677102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:32.680435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:32.680987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:32.681458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:32.682124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:32.682573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:32.683017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:32.683770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:32.684257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:32.685264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:32.685962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:32.686619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:32.687059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:32.716764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-44257672-3b07-4500-bcb3-558ff8d9d396 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045917 Aug 24 09:38:32.717330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 541/1086] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:32.814467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:32.823064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:32.824571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:32.825787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a429916e-f3c5-4044-ac7b-1abdb7fd11f6 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.157314 Aug 24 09:38:32.826328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 546/1087] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:32 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:33.729092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:33.731273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:33.737625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:33.738113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:33.738585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:33.739281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:33.739778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:33.740210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:33.768874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e426a51a-af23-4166-8814-8fc6e2dd5d42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043791 Aug 24 09:38:33.769423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 542/1088] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:33.848045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:33.848651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:33.855004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:33.855481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:33.855938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:33.856617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:33.857061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:33.857477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:33.987328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:33.995883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:33.997924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:33.999086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f3b1dfcf-0705-407f-aabc-d72170ce70dd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154966 Aug 24 09:38:33.999662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 547/1089] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:34.781947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:34.784100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:34.790474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:34.790951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:34.791388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:34.792099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:34.792556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:34.792981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:34.822273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e896c62-95d8-4b58-bcca-089681ccbd66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044762 Aug 24 09:38:34.822827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 543/1090] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:35.021886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:35.022526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:35.029673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:35.030162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:35.030605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:35.031384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:35.031793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:35.032276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:35.036324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:35.161852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:35.170362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:35.171912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:35.173103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e327ea3b-827e-4992-854a-a94eaf1b25aa tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155084 Aug 24 09:38:35.173667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 548/1091] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:35 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:35.834424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:35.836902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:35.843224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:35.843743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:35.844185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:35.844878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:35.845334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:35.845757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:35.876094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a064ff71-8622-4cb8-bb75-cda1a0b18c7c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045654 Aug 24 09:38:35.876636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 544/1092] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:36.195768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:36.196415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:36.203440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:36.203954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:36.204393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:36.205084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:36.205536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:36.205962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:36.331571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:36.340455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:36.341951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:36.343133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-143283a8-45aa-4dc0-a0a3-e9175bb2e75d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151314 Aug 24 09:38:36.343721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 549/1093] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:36 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:36.888485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:36.890662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:36.892604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=80 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:36.897205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:36.897897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:36.898339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:36.899040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:36.899495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:36.899950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:36.930916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aced84bc-7231-4a3b-97d2-00ade95088f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046462 Aug 24 09:38:36.931473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 545/1094] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:37.365319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:37.365959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:37.372343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:37.372824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:37.373287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:37.373971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:37.374424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:37.374849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:37.500680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:37.509389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:37.510884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:37.512075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-238e1cda-0479-4a9c-aad4-2df0359f393e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150684 Aug 24 09:38:37.512744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 550/1095] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:37 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:37.942534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:37.944692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:37.951508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:37.952020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:37.952457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:37.953146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:37.953601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:37.954027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:37.983519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-101b8d9a-4095-4d24-b8a9-86b9d93a161a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Aug 24 09:38:37.984086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 546/1096] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:38.535534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:38.536175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:38.542698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:38.543200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:38.543686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:38.544391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:38.545516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:38.545944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:38.674909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:38.683730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:38.685249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:38.687062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e9e802b2-ab7f-46ad-9cce-8fb09e473100 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154753 Aug 24 09:38:38.687062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 551/1097] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:38 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:38.995725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:38.998347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:39.004831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:39.005307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:39.005742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:39.006423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:39.006871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:39.007292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:39.036625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e70bc56-ac1f-4242-b931-8370cf362010 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044884 Aug 24 09:38:39.037172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 547/1098] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:39.709987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:39.710591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:39.713125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:39.717754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:39.718227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:39.718654 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:39.719331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:39.719806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:39.720226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:39.848110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:39.856521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:39.858627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:39.859817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8f18bfa3-286c-4cf4-8122-b397471de76d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153833 Aug 24 09:38:39.860401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 552/1099] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:39 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:40.048684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:40.050812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:40.057146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:40.057622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:40.058059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:40.058741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:40.059187 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:40.059628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:40.087940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6be89c73-ac58-4231-a320-8735ddfa28bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043769 Aug 24 09:38:40.088474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 548/1100] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:40.882473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:40.883198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:40.889929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:40.890487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:40.890926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:40.891642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:40.892100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:40.892575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:41.024702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:41.033194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:41.034711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:41.035882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2eeca185-68a6-4e8a-9f03-65a3e59a9c9f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.157397 Aug 24 09:38:41.036426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 553/1101] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:40 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:41.100493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:41.102647 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:41.109592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:41.110072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:41.110510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:41.111197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:41.111674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:41.112109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:41.140705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-959543e1-7118-4e25-a2ac-b722ce3c4f81 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044183 Aug 24 09:38:41.141185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 549/1102] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:42.059197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:42.059838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:42.066755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:42.067234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:42.067707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:42.068396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:42.068855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:42.069279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:42.152346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:42.154587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:42.161030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:42.161514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:42.161956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:42.162652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:42.163107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:42.163532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:42.192912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1170d28d-51e3-481b-b994-5e343634c96a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044443 Aug 24 09:38:42.193950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 550/1103] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:42.196776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:42.206316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:42.207884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:42.209046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b83f891a-d69c-42a4-908d-140e4a061aae tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153789 Aug 24 09:38:42.209626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 554/1104] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:42 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:43.205768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:43.208044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:43.214769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:43.215252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:43.215728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:43.216428 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:43.217640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:43.218069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:43.231851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:43.233114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:43.238804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:43.239375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:43.239849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:43.240639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:43.241072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:43.241492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:43.247107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-65f60706-5411-4fbf-a5c3-d7a29dfeaf5b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Aug 24 09:38:43.247699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 551/1105] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:43.370611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:43.379192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:43.380722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:43.381884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2f06f0cc-f060-4f77-a029-1113c3b58fd9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153974 Aug 24 09:38:43.382499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 555/1106] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:43 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:38:44.258481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:44.260659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:44.266932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:44.267415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:44.267904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:44.268598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:44.269055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:44.269486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:44.294054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:44.299350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-466c53e0-cf11-4faf-ba03-564d75c359cc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044913 Aug 24 09:38:44.299946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 552/1107] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:44.405058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:44.405669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:44.412491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:44.412967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:44.413405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:44.414113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:44.414560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:44.414979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:44.545387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:44.558984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:44.560563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:44.561724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-35ceabcb-6e2a-47c1-ae1b-bd5c06ca1b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.160575 Aug 24 09:38:44.562468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 556/1108] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:44 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:45.311261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:45.313945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:45.320679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:45.321158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:45.321594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:45.322279 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:45.322732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:45.323158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:45.352923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1e269eac-e94c-4f6c-ba13-ae96e50744a7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Aug 24 09:38:45.353471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 553/1109] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:45.588446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:45.589056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:45.595536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:45.606524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:45.606524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:45.606524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:45.606524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:45.607152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:45.728959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:45.738229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:45.739797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:45.740960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-129ec7a1-2ff9-43f0-a16e-51ca6da600b9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156770 Aug 24 09:38:45.741515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 557/1110] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:45 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:46.365245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:46.367422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:46.373873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:46.374352 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:46.374788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:46.375476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:46.375961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:46.376387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:46.404759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5ef3181f-c3ec-46de-8a71-5ce29ea70a92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043488 Aug 24 09:38:46.405294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 554/1111] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:46.763297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:46.763931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:46.770664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:46.771150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:46.771608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:46.772307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:46.772759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:46.773182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:46.902819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:46.911488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:46.913021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:46.914175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-887f1b87-c406-44cd-b2ab-e119c8ef8713 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154989 Aug 24 09:38:46.914733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 558/1112] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:46 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:47.416751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:47.418889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:47.426240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:47.426721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:47.427159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:47.427887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:47.428343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:47.428770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:47.456983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ab2cab28-f5fc-4d8c-b253-b6a757dea66a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Aug 24 09:38:47.457523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 555/1113] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:47.936196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:47.936732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:47.943512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:47.944015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:47.944448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:47.945125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:47.945573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:47.945991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:48.072141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:48.081330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:48.082821 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:48.084000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-80105614-80f2-4ae1-b010-36a95d961eaf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151762 Aug 24 09:38:48.084565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 559/1114] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:47 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:48.469177 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:48.471319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:48.477662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:48.478125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:48.478559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:48.479238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:48.479714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:48.480137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:48.509818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e7034072-133f-40a5-9564-4afef2558448 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044636 Aug 24 09:38:48.510371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 556/1115] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:49.106443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:49.107059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:49.113412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:49.113897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:49.114338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:49.115030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:49.115487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:49.115947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:49.243820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:49.252332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:49.253828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:49.254979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5caaa87f-4d67-45ce-950e-e3c3adb61666 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152412 Aug 24 09:38:49.255540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 560/1116] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:49 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:49.522389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:49.524557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:49.530891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:49.531365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:49.531839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:49.532523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:49.532976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:49.533401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:49.561270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e13cb4be-1df7-4d01-a8fe-ed2a2cc3c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042846 Aug 24 09:38:49.561782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 557/1117] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:50.277849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:50.278490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:50.285425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:50.285906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:50.286341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:50.287026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:50.287477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:50.287930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:50.413517 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:50.422622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:50.424140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:50.425286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-62528645-40e3-4c7a-b2a0-97f2fef64d94 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151350 Aug 24 09:38:50.425839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 561/1118] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:50 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:50.573283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:50.575461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:50.582410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:50.582896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:50.583332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:50.584059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:50.584522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:50.584948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:50.614065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-82e75e87-2e91-45d8-8d6f-331cc602a91a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044648 Aug 24 09:38:50.614550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 558/1119] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:51.447920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:51.448460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:51.455272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:51.455779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:51.456221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:51.456909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:51.457364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:51.457787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:51.584110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:51.592895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:51.594928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:51.596130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-92f70959-e868-4099-bad7-4340b79a8bf7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152169 Aug 24 09:38:51.596680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 562/1120] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:51 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:51.626088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:51.628237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:51.634515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:51.634997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:51.635435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:51.636151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:51.636606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:51.637028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:51.666077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58bf1be2-96d8-4ef2-8fdd-6add6dedf561 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043945 Aug 24 09:38:51.666624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 559/1121] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:52.618301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:52.618912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:52.625515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:52.625993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:52.626435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:52.627117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:52.627566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:52.628045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:52.678441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:52.680645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:52.687007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:52.687491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:52.688029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:52.688724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:52.689965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:52.690399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:52.720434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bb911ef2-8f7a-4996-8886-eb03c3844c04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046020 Aug 24 09:38:52.721000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 560/1122] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:38:52.758421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:52.766948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:52.768488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:52.769641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-62267dbd-c7e6-4a74-95d7-c4680c4c2a88 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155239 Aug 24 09:38:52.770186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 563/1123] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:52 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:53.732684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:53.735318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:53.741801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:53.742282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:53.742718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:53.743410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:53.743967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:53.744391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:53.773307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d71d01ad-da33-434a-9a9b-fe56c3fc9a02 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044366 Aug 24 09:38:53.773668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 561/1124] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:53.792593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:53.793239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:53.800202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:53.800682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:53.801132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:53.801805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:53.802260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:53.802685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:53.927788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:53.929949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:38:53.937563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:53.939071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:53.940273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-428cc01a-cd25-47d9-98de-46319b19a138 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151589 Aug 24 09:38:53.944162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 564/1125] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:53 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:54.785709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:54.787894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:54.794204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:54.794681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:54.795120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:54.795845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:54.796905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:54.797333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:54.825660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-80c86b9e-b053-468f-8ffd-2e9cc865d6d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043768 Aug 24 09:38:54.826171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 562/1126] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:54.965044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:54.965689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:54.973066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:54.973544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:54.973975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:54.974663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:54.975116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:54.975538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:55.108724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:55.117871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:55.119383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:55.120616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-19af4c43-2eb2-4dfb-baff-4f5c96e62192 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.159893 Aug 24 09:38:55.121155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 565/1127] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:54 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:55.837513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:55.839760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:55.846155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:55.846639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:55.847078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:55.847807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:55.848268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:55.848698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:55.878046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51434bc4-d322-4c99-9e6e-61b143cd7473 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044784 Aug 24 09:38:55.878600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 563/1128] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:56.148211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:56.148211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:56.149935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:56.150422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:56.150864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:56.151555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:56.152041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:56.152463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:56.277897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:56.286951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:56.288490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:56.289653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a2805342-ba44-4bcf-8ee1-42a9f42da28f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150756 Aug 24 09:38:56.290214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 566/1129] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:56 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:56.891000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:56.893223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:56.899606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:56.900100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:56.900569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:56.901267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:56.901727 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:56.902157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:56.931164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6d1ed882-d775-4b31-a3d1-cf50101ae608 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044674 Aug 24 09:38:56.931735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 564/1130] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:57.313190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:57.313804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:57.320181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:57.320659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:57.321094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:57.321780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:57.322228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:57.322653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:57.460401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:57.469789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:57.471448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:57.472650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dc9b0e1c-1eb8-4161-ba19-1ee82d051613 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.163910 Aug 24 09:38:57.473247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 567/1131] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:57 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:57.942907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:57.945079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:57.951485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:57.951993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:57.953052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:57.953743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:57.954202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:57.954623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:57.983920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a82aa76d-2c33-4572-9d4e-95995d2485ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044984 Aug 24 09:38:57.984467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 565/1132] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:58.493958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:58.494638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:58.501084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:58.501555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:58.501985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:58.502664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:58.503112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:58.503529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:58.630364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:58.638758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:58.640359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:58.641509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f6481570-fe98-4531-a562-21d8d79955ac tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151351 Aug 24 09:38:58.642059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 568/1133] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:58 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:38:58.996246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:58.998372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:59.004745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:59.005216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:59.005653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:59.006330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:59.006778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:59.007192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:59.039331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1dc66f2b-f24d-4c24-81e8-eaaccf6e7345 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046706 Aug 24 09:38:59.040289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 566/1134] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:38:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:38:59.664356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:38:59.664961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:38:59.671836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:59.672313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:59.672740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:59.673419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:38:59.673864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:38:59.674279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:38:59.943099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:59.951851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:59.953589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:38:59.954746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a1433369-242e-45a6-9806-9e010c7ba600 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.294214 Aug 24 09:38:59.955288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 569/1135] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:38:59 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:00.052386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:00.054585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:00.060939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:00.061445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:00.061880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:00.062567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:00.063021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:00.063446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:00.091398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b114ce82-d6a9-4241-b166-ae8c855d4dda tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Aug 24 09:39:00.091961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 567/1136] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:00.978456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:00.979018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:00.985462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:00.985936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:00.986368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:00.987045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:00.987491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:00.987943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:01.104138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:01.106275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:01.113010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:01.113491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:01.113922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:01.114615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:01.115064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:01.115485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:01.116949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:01.126201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:01.127722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:01.128866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bfd26415-6c53-407c-bca9-8d1be4839de0 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154415 Aug 24 09:39:01.129407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 570/1137] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:00 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:01.145590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0c6a36e2-c2cd-4bfc-8542-447ccdb799ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Aug 24 09:39:01.146152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 568/1138] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:02.151928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:02.152546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:02.158013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:02.159167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:02.159679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:02.160111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:02.160252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:02.160806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:02.161283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:02.161852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:02.166648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:02.167136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:02.167570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:02.168330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:02.168788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:02.169215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:02.186443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:02.200105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ec423559-bcdd-4ca8-9145-ecfd4b604d7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Aug 24 09:39:02.200666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 569/1139] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:02.288244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:02.297345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:02.298844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:02.300048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ae70d1cb-8bbb-4cdd-a9c8-419f6f09cb0f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152724 Aug 24 09:39:02.300589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 571/1140] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:02 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:03.213755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:03.216089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:03.223389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:03.223900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:03.224341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:03.225022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:03.225471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:03.225896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:03.255733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a2c16cf2-a790-432f-aa53-1adde9f41d09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047001 Aug 24 09:39:03.256281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 570/1141] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:03.322818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:03.323649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:03.330679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:03.331164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:03.331623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:03.332333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:03.332784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:03.333236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:03.468601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:03.478720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:03.480312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:03.481471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c6b0f8ac-bd33-460c-b19e-50d5adf14fc4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.163146 Aug 24 09:39:03.486390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 572/1142] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:03 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:04.268200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:04.270366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:04.276907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:04.277392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:04.277829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:04.278519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:04.278974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:04.279402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:04.308131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f5e89d11-cb7d-4386-ac57-b7cab493a850 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043878 Aug 24 09:39:04.308682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 571/1143] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:04.504957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:04.505602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:04.512023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:04.512498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:04.512929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:04.513613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:04.514059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:04.514482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:04.644840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:04.653618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:04.655122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:04.656314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bc91677c-045f-40c7-b9ab-7b85d4aacbc7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155746 Aug 24 09:39:04.656853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 573/1144] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:04 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:39:05.320725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:05.322855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:05.330046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:05.330556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:05.331023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:05.331765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:05.332229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:05.332659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:05.361910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b3f04cff-0e21-451d-a6d8-3e07b6c59a07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045197 Aug 24 09:39:05.362464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 572/1145] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:05.679102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:05.679759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:05.686171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:05.686816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:05.687073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:05.687906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:05.688362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:05.689357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:05.817916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:05.826660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:05.828267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:05.829459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bed5efdb-457b-47ad-a169-e35e6079ec1a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154154 Aug 24 09:39:05.830009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 574/1146] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:05 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:06.373833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:06.376593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:06.382533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:06.383023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:06.383467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:06.384257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:06.384720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:06.385155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:06.413354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51cb240d-b861-4d94-bdc8-fe40bab3d299 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043672 Aug 24 09:39:06.413889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 573/1147] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:06.852033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:06.852673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:06.859087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:06.859573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:06.860045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:06.860742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:06.861195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:06.861623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:06.990241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:06.998780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:07.000382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:07.002043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e206df1f-d413-4392-9dd3-88d2c3d0c646 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153959 Aug 24 09:39:07.002587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 575/1148] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:06 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:07.424918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:07.427070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:07.433460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:07.433937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:07.434375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:07.435070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:07.435529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:07.435988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:07.465691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-91f0c7b1-70ce-48bc-8f46-5bc92b0f73dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044807 Aug 24 09:39:07.466239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 574/1149] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:08.025187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:08.025809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:08.032556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:08.033046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:08.033490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:08.034194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:08.034651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:08.035079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:08.163671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:08.172218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:08.174368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:08.175521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-846386e8-39b4-40c7-ab94-676a99505bf3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154227 Aug 24 09:39:08.176092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 576/1150] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:08 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:08.477989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:08.480175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:08.482696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=60 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:08.487922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:08.488411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:08.488855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:08.489555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:08.490019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:08.490447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:08.519197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-46eb8121-4c2e-4209-91ac-a1e4b4e4d5df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 Aug 24 09:39:08.519784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 575/1151] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:09.198564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:09.199135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:09.205461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:09.205944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:09.206381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:09.207065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:09.207516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:09.207967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:09.338338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:09.347518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:09.349054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:09.350204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-54b1029a-0ffa-4d1b-82ce-1d36ceda052c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155621 Aug 24 09:39:09.350750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 577/1152] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:09 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:09.531410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:09.534211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:09.540817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:09.541303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:09.541745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:09.542439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:09.542904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:09.543334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:09.571517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-255014ec-f8b0-41b9-b851-ccaff935b4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Aug 24 09:39:09.572090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 576/1153] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:10.372835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:10.373434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:10.375765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=52 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:10.380973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:10.381455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:10.381898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:10.382586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:10.383040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:10.383466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:10.508109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:10.516808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:10.518331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:10.519474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-750b1389-96d0-4a94-a592-4e7bab37efc2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150536 Aug 24 09:39:10.520205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 578/1154] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:10 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:39:10.583943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:10.586234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:10.592676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:10.593151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:10.593673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:10.594366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:10.595336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:10.595786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:10.625040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-43303b9d-f64f-4863-a4be-4a1fe53d43f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045225 Aug 24 09:39:10.625588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 577/1155] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:11.546962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:11.547577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:11.554025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:11.554513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:11.554957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:11.555675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:11.556138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:11.556566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:11.637549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:11.639695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:11.646082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:11.646561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:11.646996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:11.647714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:11.648165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:11.648584 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:11.677665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eef8fa04-0146-4784-b1eb-ed2f696f6460 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043998 Aug 24 09:39:11.678223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 578/1156] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:11.685801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:11.694874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:11.696409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:11.697544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-157a7af4-1ecc-4825-a2c5-ccb71bab846c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.159068 Aug 24 09:39:11.698088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 579/1157] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:11 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:12.690480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:12.692570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:12.699071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:12.699545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:12.700006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:12.700683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:12.701130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:12.701548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:12.720105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:12.720715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:12.727099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:12.727613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:12.728049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:12.728741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:12.729195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:12.729619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:12.731792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-46bdc887-f799-4f8e-94f4-c6d3c3885b22 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045803 Aug 24 09:39:12.732549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 579/1158] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:12.856674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:12.865227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:12.866721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:12.867935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-06309e51-bc7d-43f7-83de-3f998e28a940 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151744 Aug 24 09:39:12.868502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 580/1159] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:12 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:39:13.743390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:13.745504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:13.752199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:13.752675 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:13.753108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:13.753791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:13.754242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:13.755004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:13.787259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-136dc0fd-bad4-4dd5-b439-4a93c1050f7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046840 Aug 24 09:39:13.787259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 580/1160] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:13.890698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:13.891857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:13.898215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:13.898693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:13.899128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:13.899848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:13.900322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:13.900727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:13.915676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:14.026765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:14.036261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:14.037748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:14.038893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a9485bbe-b012-4e9f-abba-24d954512e92 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.152128 Aug 24 09:39:14.039431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 581/1161] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:13 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:14.798907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:14.801137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:14.807544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:14.808059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:14.808514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:14.809203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:14.809657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:14.810089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:14.839387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c34017a3-9e41-43df-924c-192dfbbd161c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Aug 24 09:39:14.839975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 581/1162] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:15.060814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:15.061380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:15.068003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:15.068482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:15.068912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:15.069596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:15.070044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:15.070463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:15.201473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:15.211021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:15.212559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:15.213724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c5644df8-cdf6-4f78-92be-783d665fa0f3 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156843 Aug 24 09:39:15.214445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 582/1163] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:15 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:15.851627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:15.853816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:15.860913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:15.861408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:15.861833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:15.862526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:15.862981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:15.863408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:15.891488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-29600724-4aaf-49a5-b942-110c0001ee8f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Aug 24 09:39:15.892078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 582/1164] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:16.237458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:16.238068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:16.244015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:16.244490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:16.244918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:16.245802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:16.246251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:16.246676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:16.373824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:16.382925 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:16.384448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:16.385598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b5c0e993-54fe-47fe-a2bc-4b87e5182781 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151952 Aug 24 09:39:16.386136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 583/1165] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:16 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:39:16.903079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:16.905262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:16.912416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:16.912901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:16.913340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:16.914037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:16.914491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:16.914995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:16.943366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2bf88f3d-6036-4423-bb50-05677a8c6082 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Aug 24 09:39:16.943959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 583/1166] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:17.408818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:17.409686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:17.415913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:17.416287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:17.416724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:17.417413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:17.417867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:17.418290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:17.547278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:17.555834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:17.557342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:17.558488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d4bd83a1-af20-4c30-8fe7-cbf0a3d04e63 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153993 Aug 24 09:39:17.559036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 584/1167] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:17 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:17.955332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:17.957518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:17.964188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:17.964676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:17.965114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:17.965808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:17.966266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:17.966695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:17.995141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-88c43fee-dca0-4ade-a2a0-fc2ebf86edd6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044501 Aug 24 09:39:17.995707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 584/1168] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:18.581248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:18.581796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:18.588340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:18.588823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:18.589258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:18.589945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:18.590404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:18.590832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:18.716530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:18.725424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:18.726945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:18.739718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1c0bb9bf-4bd3-40c8-b9bc-011c01079156 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.151364 Aug 24 09:39:18.739718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 585/1169] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:18 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:19.008065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:19.010188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:19.017199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:19.017687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:19.018123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:19.018812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:19.019269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:19.019727 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:19.048679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8e2422c7-053c-43a3-8c46-c9de2c26bd91 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Aug 24 09:39:19.049266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 585/1170] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:19.751519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:19.752106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:19.758392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:19.758871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:19.759303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:19.760017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:19.760472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:19.760893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:19.886521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:19.895707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:19.897230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:19.898469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-41766829-3210-43c7-95ef-c0679908f8eb tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150931 Aug 24 09:39:19.899011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 586/1171] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:19 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:20.061059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:20.063237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:20.069707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:20.070191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:20.070626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:20.071314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:20.071813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:20.072241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:20.075764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:20.101882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-111c89d6-410a-43be-bc70-4fffbf999863 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044798 Aug 24 09:39:20.102423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 586/1172] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:20.921518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:20.922124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:20.929093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:20.929568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:20.930001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:20.930688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:20.931138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:20.931566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:21.061133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:21.069675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:21.071172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:21.072363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8f42bfda-6dae-4fbc-8b34-11220ddb016b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.154786 Aug 24 09:39:21.072940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 587/1173] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:20 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:21.114818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:21.116976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:21.123302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:21.123810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:21.124250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:21.124964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:21.125418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:21.125846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:21.153719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aab4098e-32d7-43a3-b4c0-18698f23862c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043864 Aug 24 09:39:21.154269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 587/1174] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:22.094368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:22.095691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:22.102685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:22.103172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:22.103640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:22.104349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:22.104807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:22.105239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:22.166429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:22.168590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:22.174720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:22.175200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:22.175659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:22.176348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:22.176822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:22.177242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:22.206545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6a600ab9-f3ee-4f4b-b2dc-ebaf4c2d8eed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Aug 24 09:39:22.207102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 588/1175] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:22.232818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:22.241348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:22.242855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:22.244038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8977b73c-0eb4-474b-a3d0-ce9a4c53f57b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.153661 Aug 24 09:39:22.244585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 588/1176] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:22 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:23.219050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:23.221733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:23.228086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:23.228563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:23.228996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:23.229688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:23.230144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:23.230569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:23.258956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-07d3585b-caef-4f3f-bc25-7af1e8119d99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Aug 24 09:39:23.259497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 589/1177] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:23.266026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:23.266747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:23.273420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:23.273897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:23.274332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:23.275023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:23.275473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:23.275927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:23.406051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:23.415552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:23.417082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:23.418319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b0181502-e61f-4c47-99e8-b8dd4d41be70 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156097 Aug 24 09:39:23.419024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 589/1178] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:23 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:24.270784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:24.272946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:24.279441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:24.279956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:24.280389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:24.281069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:24.281517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:24.281937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:24.310921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-458bd8ea-fab0-43e8-a5d3-7813319b1026 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044535 Aug 24 09:39:24.311573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 590/1179] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:24.441070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:24.441676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:24.448108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:24.448583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:24.449013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:24.449685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:24.450136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:24.450552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:24.575166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:24.584463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:24.586610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:24.587553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b075d7ae-d9dc-4443-925c-600f70cac2d4 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.150399 Aug 24 09:39:24.588121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 590/1180] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:24 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 24 09:39:25.322488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:25.324662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:25.331348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:25.331866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:25.332302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:25.332995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:25.333449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:25.333874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:25.362905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f873a095-5202-4bf0-8252-51e828ac8f89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Aug 24 09:39:25.363451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 591/1181] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:25.612337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:25.612896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:25.619308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:25.619832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:25.620279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:25.620972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:25.621428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:25.621858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:25.752218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:25.761167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:25.762672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:25.763869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fd71bf1a-2851-4447-b8c7-64939b87558b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.156114 Aug 24 09:39:25.764426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 591/1182] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:25 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:26.375027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:26.377694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:26.384031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:26.384514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:26.384949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:26.385636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:26.386090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:26.386518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:26.416011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1505462d-d67a-48f3-8193-9a33e446d77d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044925 Aug 24 09:39:26.416572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 592/1183] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:26.786001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:26.786611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:26.792582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:26.793054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:26.793486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:26.794162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:26.794609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:26.795030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:26.926361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:26.934999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:26.936582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:26.937734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-914851a1-b6ce-49bf-a773-f3d3c83d732b tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 200 len: 1748 microversion: 2.20 time: 0.155545 Aug 24 09:39:26.938324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 592/1184] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:26 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 1748 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:27.015403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:27.015861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:27.021698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.022179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.022616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.023302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.023789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.024216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.427918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:27.430142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:27.436038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.436521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.436956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.437642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.438121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.438583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.471359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d0fd7f88-a41f-47c5-937f-2ec2b71a3a89 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047370 Aug 24 09:39:27.471951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 593/1185] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:27.637558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-36b7e031-b575-4add-834c-f8f63aafbb48 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-volume_attachments/1e5011d7-58af-4e64-aea9-c8b9db6185a6" status: 202 len: 0 microversion: 2.20 time: 0.626031 Aug 24 09:39:27.638123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 593/1186] 10.222.0.16 () {60 vars in 1457 bytes} [Wed Aug 24 09:39:27 2022] DELETE /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-volume_attachments/1e5011d7-58af-4e64-aea9-c8b9db6185a6 => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:39:27.647156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:27.649381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:27.655491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.656009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.656453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.657144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.657604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.658030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.686325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cb965503-144d-4b32-ab67-b94976b5815f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043233 Aug 24 09:39:27.686868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 594/1187] 10.222.0.16 () {60 vars in 1343 bytes} [Wed Aug 24 09:39:27 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:39:27.747312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:27.747859 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:27.754921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.755401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.755869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.756563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:27.757019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:27.757444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:27.781838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:39:27.787897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.compute.api [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Working on deleting snapshot 8eec47fe-375b-4903-a5f4-64730ec4b210 from shelved instance... Aug 24 09:39:28.483357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:28.486181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:28.492659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:28.493088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:28.493525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:28.494225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:28.494684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:28.495255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:28.523620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-51ac2fe2-4fb0-425b-acd7-0b08d5eb0984 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044085 Aug 24 09:39:28.524154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 595/1188] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:29.066538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Doing local delete in cell 050771cb-a121-45a6-9902-2168b65adc50(cell1) {{(pid=121142) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 24 09:39:29.067280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:29.067794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:29.068234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:29.068659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.compute.api [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 24 09:39:29.075057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] deallocate_for_instance() {{(pid=121142) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 24 09:39:29.534907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:29.537078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:29.543739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:29.544942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:29.545093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:29.545771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:29.546221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:29.546640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:29.578410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6b61a6f2-5e63-4557-96ce-8cfa2b5fdbc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047463 Aug 24 09:39:29.579159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 596/1189] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:29.973559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-10c6ac7a-c2c5-4a57-b85c-59b760fd974d req-8658adbb-f48d-4e09-98cc-cfe2e9a151c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e093c82-b762-45aa-840b-26b6b982f8bc", "name": "network-vif-deleted", "tag": "c90b8067-74c1-43cb-b490-fe8f8d77018f"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:39:29.982736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-10c6ac7a-c2c5-4a57-b85c-59b760fd974d req-8658adbb-f48d-4e09-98cc-cfe2e9a151c1 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:29.983213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-10c6ac7a-c2c5-4a57-b85c-59b760fd974d req-8658adbb-f48d-4e09-98cc-cfe2e9a151c1 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:29.987258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-10c6ac7a-c2c5-4a57-b85c-59b760fd974d req-8658adbb-f48d-4e09-98cc-cfe2e9a151c1 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:29.995674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.compute.server_external_events [req-10c6ac7a-c2c5-4a57-b85c-59b760fd974d req-8658adbb-f48d-4e09-98cc-cfe2e9a151c1 service nova] Unable to find a host for instance 9e093c82-b762-45aa-840b-26b6b982f8bc. Dropping event network-vif-deleted {{(pid=121141) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 24 09:39:29.996558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-10c6ac7a-c2c5-4a57-b85c-59b760fd974d req-8658adbb-f48d-4e09-98cc-cfe2e9a151c1 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.027337 Aug 24 09:39:29.999986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 597/1190] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 24 09:39:30.052241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Updating instance_info_cache with network_info: [] {{(pid=121142) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 24 09:39:30.590631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:30.592808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:30.599912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:30.600389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:30.600822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:30.601512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:30.601963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:30.602383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:30.628736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:30.633444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-38dd0de1-1bbe-41be-b112-5518024586c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046787 Aug 24 09:39:30.634205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 598/1191] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:30.674194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.scheduler.client.report [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Deleted allocations for instance 9e093c82-b762-45aa-840b-26b6b982f8bc Aug 24 09:39:30.938698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=2,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:31.064435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b9af690d-f4be-4083-a263-73ab4dd28432 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 204 len: 0 microversion: 2.20 time: 3.320896 Aug 24 09:39:31.065227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 594/1192] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Aug 24 09:39:27 2022] DELETE /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 0 bytes in 3322 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:39:31.073724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:31.074345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:31.080745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:31.081232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:31.081666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:31.082357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:31.082809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:31.083300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:31.097081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] HTTP exception thrown: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Request method failure captured: Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc HTTP/1.1 Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8mM3Ug07VOcptQ0Yj1o3-Tz1EgPakdk8vikxbKE6MDN6hZ7lrvV8xnDHazAir6NUuwBhkpnJaB_KLKmGNKcD-WWlqyjsvAPwMZ6XhdCCsfobvlPzWpgFPs3o1Bc22ChZSy4-J_sGL7HYOXBFcB2HOjVU_roXNwZ6nAcY91-qUMa9o Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:39:31.098897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00ce4a2669e43dcb5bc8a2d77b11c2f", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: cbcaa84bc9c54d7aa4178d0174a5936e Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:39:31.100619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '9e093c82-b762-45aa-840b-26b6b982f8bc'} Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:39:31.101501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:39:31.102776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:39:31.105096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Returning 404 to user: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:39:31.105096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d73a74e0-c911-4ed1-a9c4-b461441ea67c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 404 len: 111 microversion: 2.20 time: 0.030587 Aug 24 09:39:31.105096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 599/1193] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:31 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:39:31.112369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-830ec019-d125-4baf-b6b1-b986048f85a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '.version_select at 0x7fa918082a60>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:31.191746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-830ec019-d125-4baf-b6b1-b986048f85a7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-310762633" status: 204 len: 0 microversion: 2.20 time: 0.083867 Aug 24 09:39:31.192272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 595/1194] 10.222.0.16 () {60 vars in 1259 bytes} [Wed Aug 24 09:39:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-310762633 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:39:31.646244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:31.648641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:31.655011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:31.655497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:31.655974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:31.657190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:31.657647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:31.658075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:31.689132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-14f6315b-eca5-4ce1-b478-91f7ecb888f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047062 Aug 24 09:39:31.690027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 600/1195] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:32.010524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-62a0aa46-be23-489e-9d5f-ab1c3519c5e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Action: 'create', calling method: .version_select at 0x7fa912df0940>, body: {"keypair": {"name": "tempest-keypair-1734587211", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCzSCqMPA81025e35trD8zXdxZphW9HqZ07C3SAp8rgWql2kUsKjRnOmtOKRRvcxBeMeTxnwJZD7YjErLypa/weGPWb2EzXLqGPyUUX4y6iw4QUdQx3qDpE7OaCiRjdahg=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:39:32.031246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-62a0aa46-be23-489e-9d5f-ab1c3519c5e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:39:32.035826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-62a0aa46-be23-489e-9d5f-ab1c3519c5e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for user cbcaa84bc9c54d7aa4178d0174a5936e and project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:39:32.130994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-62a0aa46-be23-489e-9d5f-ab1c3519c5e7 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.125111 Aug 24 09:39:32.131801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 596/1196] 10.222.0.16 () {62 vars in 1200 bytes} [Wed Aug 24 09:39:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 126 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 24 09:39:32.701373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:32.703639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:32.710025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:32.710510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:32.711211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:32.711936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:32.712391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:32.712820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:32.742560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-91c6fa28-b1e7-406d-ad77-96f73d8b1641 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Aug 24 09:39:32.743255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 601/1197] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:33.755103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:33.757449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:33.763932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:33.764420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:33.764862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:33.765561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:33.766583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:33.767019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:33.796912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-30613fba-f9b5-4196-900d-797d40d16648 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046327 Aug 24 09:39:33.797949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 597/1198] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:34.565480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-991909396", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "570949e9-80a8-4560-b0ca-52af70ebdac6"}], "security_groups": [{"name": "tempest-securitygroup--1372393387"}], "key_name": "tempest-keypair-1734587211", "user_data": "}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:39:34.671774 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] validate_networks() for [('570949e9-80a8-4560-b0ca-52af70ebdac6', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:39:34.809967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:34.812335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:34.818925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:34.819489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:34.820041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:34.820839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:34.821893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:34.821893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:34.853097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1fb70652-a2af-4ac4-bce2-eafec98b697f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047137 Aug 24 09:39:34.853870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 598/1199] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:35.039439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:39:35.039930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:39:35.040412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:39:35.040849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:39:35.041266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:39:35.050102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:35.050589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:35.051029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:35.051803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:35.052309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:35.052725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:35.069112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:39:35.073012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Getting quotas for user cbcaa84bc9c54d7aa4178d0174a5936e and project d00ce4a2669e43dcb5bc8a2d77b11c2f. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:39:35.084336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:39:35.086905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:39:35.214855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8c5432ae-b153-413d-a0e7-977984e267c2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.653685 Aug 24 09:39:35.215493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 602/1200] 10.222.0.16 () {62 vars in 1188 bytes} [Wed Aug 24 09:39:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 24 09:39:35.226004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2857783d-9520-4584-bb91-12fbea5949ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:35.226624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2857783d-9520-4584-bb91-12fbea5949ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:35.280937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2857783d-9520-4584-bb91-12fbea5949ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:35.288706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2857783d-9520-4584-bb91-12fbea5949ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:35.290210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2857783d-9520-4584-bb91-12fbea5949ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:35.291356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2857783d-9520-4584-bb91-12fbea5949ff tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1281 microversion: 2.20 time: 0.069103 Aug 24 09:39:35.299808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 599/1201] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:35 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:35.866212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:35.868486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:35.876743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:35.877219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:35.877653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:35.878356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:35.878789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:35.879212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:35.907695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c8ce1570-00c7-48e6-a1c5-ced4b167566a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045968 Aug 24 09:39:35.908238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 603/1202] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:36.314087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6cefdecb-ca34-45b4-8769-f3e0af5343c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:36.314696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6cefdecb-ca34-45b4-8769-f3e0af5343c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:36.371644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6cefdecb-ca34-45b4-8769-f3e0af5343c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:36.381442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6cefdecb-ca34-45b4-8769-f3e0af5343c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:36.383049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6cefdecb-ca34-45b4-8769-f3e0af5343c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:36.384326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6cefdecb-ca34-45b4-8769-f3e0af5343c8 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1281 microversion: 2.20 time: 0.074652 Aug 24 09:39:36.384857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 600/1203] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:36 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:36.920207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:36.923039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:36.929412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:36.929896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:36.930334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:36.931024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:36.931479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:36.931934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:36.960166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b737b6da-325b-4601-b743-03c8b6fa13f9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043923 Aug 24 09:39:36.960978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 604/1204] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:37.407225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9897e18c-cdbb-4767-bd71-5810c546a8ef tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:37.408461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9897e18c-cdbb-4767-bd71-5810c546a8ef tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:37.473852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9897e18c-cdbb-4767-bd71-5810c546a8ef tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:37.482888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9897e18c-cdbb-4767-bd71-5810c546a8ef tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:37.485567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9897e18c-cdbb-4767-bd71-5810c546a8ef tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:37.487001 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9897e18c-cdbb-4767-bd71-5810c546a8ef tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1281 microversion: 2.20 time: 0.084451 Aug 24 09:39:37.488120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 601/1205] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:37 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:37.972808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:37.974942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:37.981330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:37.981811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:37.982251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:37.982937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:37.983387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:37.983844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:38.012988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-803aed6f-d97f-4948-962c-c76808ed4624 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044310 Aug 24 09:39:38.013530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 605/1206] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:38.510435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cdab6ed8-dd27-4ce3-8334-ccd444452955 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:38.511049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cdab6ed8-dd27-4ce3-8334-ccd444452955 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:38.569976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdab6ed8-dd27-4ce3-8334-ccd444452955 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:38.577895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdab6ed8-dd27-4ce3-8334-ccd444452955 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:38.579968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cdab6ed8-dd27-4ce3-8334-ccd444452955 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:38.581144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cdab6ed8-dd27-4ce3-8334-ccd444452955 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1281 microversion: 2.20 time: 0.074771 Aug 24 09:39:38.581727 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 602/1207] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:38 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:39.025212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:39.027570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:39.034055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:39.034541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:39.034979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:39.035702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:39.036158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:39.036582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:39.065732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c428a6de-a5fa-46d3-a0be-ab5cc041746b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044578 Aug 24 09:39:39.066285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 606/1208] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:39.604573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:39.605190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:39.607540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:39.612815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:39.613302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:39.613745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:39.614439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:39.614898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:39.615333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:39.677742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:39.686116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:39.687717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:39.688816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-93818340-4782-4ab9-9017-e69dda5c3734 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1285 microversion: 2.20 time: 0.088135 Aug 24 09:39:39.689382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 603/1209] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:39 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:40.078866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:40.081034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:40.087711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:40.088193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:40.088631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:40.089324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:40.089776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:40.090203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:40.120002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-62a95098-f5b4-44bd-ae88-6e6e8ba7f9ab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045553 Aug 24 09:39:40.120576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 607/1210] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:40.710451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:40.711345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:40.721378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:40.721378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:40.721378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:40.721378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:40.721713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:40.721713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:40.783052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:40.791050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:40.792594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:40.793712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-883926a4-ff99-4313-9c25-30eb8b6ef152 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1277 microversion: 2.20 time: 0.087198 Aug 24 09:39:40.794270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 604/1211] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:40 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1277 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:41.132459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:41.134605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:41.136937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:41.141476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:41.141949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:41.142408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:41.143085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:41.143531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:41.143976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:41.173719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1b2efe5a-5671-43a4-a98e-583e86331bc3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045234 Aug 24 09:39:41.174257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 608/1212] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:41.816359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:41.817093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:41.823443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:41.824016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:41.824460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:41.825143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:41.825589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:41.826010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:41.868427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:41.868835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:41.875871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:41.876619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:41.877055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:41.877764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:41.878216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:41.878641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:41.894888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:41.903514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:41.905410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:41.906494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f5f1668d-31bc-466b-b483-2b6d9501ab2d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1351 microversion: 2.20 time: 0.094301 Aug 24 09:39:41.919819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 605/1213] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:41 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1351 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:41.920410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c6bd0c33-0d78-480d-8e34-091c560a4b00 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee/ips" status: 200 len: 145 microversion: 2.1 time: 0.044074 Aug 24 09:39:41.920410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 609/1214] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 09:39:41 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:42.186063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:42.189022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:42.195145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:42.195994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:42.196434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:42.197132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:42.197591 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:42.198087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:42.228149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c758c372-7967-415b-a74e-7d2d01ed7bf6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046057 Aug 24 09:39:42.228748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 606/1215] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:42.932411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:42.933030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:42.940511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:42.940990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:42.941426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:42.942115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:42.942563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:42.942989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:43.068489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:43.076618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:43.078708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:43.079846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c5463ebf-76f5-4d96-9871-a30dca281894 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1407 microversion: 2.20 time: 0.151422 Aug 24 09:39:43.080415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 610/1216] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:42 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:43.195016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-2e33ffa4-fef6-4ad3-84ba-0d4594c77cc4 req-d704f91c-9e71-40e7-b40c-1d5f9668ae47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7305802-e1e6-46dc-a090-0748e35d748b", "tag": "ec839274-e8bb-48c3-bcdc-cc5833943b51"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:39:43.206091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-2e33ffa4-fef6-4ad3-84ba-0d4594c77cc4 req-d704f91c-9e71-40e7-b40c-1d5f9668ae47 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:43.206552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-2e33ffa4-fef6-4ad3-84ba-0d4594c77cc4 req-d704f91c-9e71-40e7-b40c-1d5f9668ae47 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:43.206986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-2e33ffa4-fef6-4ad3-84ba-0d4594c77cc4 req-d704f91c-9e71-40e7-b40c-1d5f9668ae47 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:43.220571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-2e33ffa4-fef6-4ad3-84ba-0d4594c77cc4 req-d704f91c-9e71-40e7-b40c-1d5f9668ae47 service nova] Creating event network-changed:ec839274-e8bb-48c3-bcdc-cc5833943b51 for instance f7305802-e1e6-46dc-a090-0748e35d748b on hv-cinder-85032 Aug 24 09:39:43.225716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-2e33ffa4-fef6-4ad3-84ba-0d4594c77cc4 req-d704f91c-9e71-40e7-b40c-1d5f9668ae47 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034666 Aug 24 09:39:43.226442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 607/1217] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:43.239609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:43.241961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:43.248249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:43.248727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:43.249158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:43.249901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:43.250298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:43.250825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:43.280126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6ad6cce3-b55d-4c17-9f71-9a8ffb4b39e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044425 Aug 24 09:39:43.280695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 611/1218] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:44.108826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:44.110032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:44.116151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:44.116624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:44.117055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:44.117728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:44.118172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:44.118590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:44.245636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:44.253686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:44.255180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:44.256348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9021bd71-b231-474b-9aa1-b7a335aa0306 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1407 microversion: 2.20 time: 0.151794 Aug 24 09:39:44.256902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 608/1219] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:44 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:44.292211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:44.294483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:44.301480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:44.301965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:44.302403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:44.303098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:44.303553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:44.304241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:44.332326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1f6c0b64-8cdf-46cb-8983-49c28e36aaad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Aug 24 09:39:44.332872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 612/1220] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:45.278643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:45.279259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:45.286398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:45.286879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:45.287314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:45.288035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:45.288491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:45.288949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:45.345398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:45.347549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:45.349410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:45.350075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:45.355433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:45.355955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:45.362420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:45.362420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:45.362420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:45.362420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:45.389989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9f7ea8d5-3476-4b4c-9edd-54413b3ab679 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049174 Aug 24 09:39:45.391441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 613/1221] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:45.421113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:45.429320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:45.430829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:45.431999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aea30c0f-183a-4272-9325-116315a17d04 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1407 microversion: 2.20 time: 0.157251 Aug 24 09:39:45.432564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 609/1222] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:45 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:46.402431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:46.404603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:46.411764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:46.412250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:46.412687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:46.413381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:46.413833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:46.414255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:46.443728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-87cc701f-b3f7-4117-8ea3-9f89abc0ab14 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045243 Aug 24 09:39:46.444284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 614/1223] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:46.453932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:46.454595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:46.461255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:46.461665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:46.462092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:46.462771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:46.463217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:46.463657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:46.589631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:46.597820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:46.599315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:46.600448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-66d8f646-c2d0-42ed-b219-7a4dadcb833d tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1407 microversion: 2.20 time: 0.150518 Aug 24 09:39:46.601007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 610/1224] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:46 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:47.456486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:47.458691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:47.465795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:47.466280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:47.466716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:47.467411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:47.467893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:47.468319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:47.497059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dc75c644-85bb-465a-a65c-be06b849b7a5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045406 Aug 24 09:39:47.497609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 615/1225] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:47.622291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:47.622838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:47.629784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:47.630261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:47.630690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:47.631375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:47.631847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:47.632272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:47.764021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:47.772321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:47.775002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:47.775002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-642df25b-01f8-470d-874c-257bf8a0a2ec tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1407 microversion: 2.20 time: 0.156533 Aug 24 09:39:47.775499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 611/1226] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:47 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:48.350760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-6d87b253-cfdf-478a-ac1c-b564cfb47cb2 req-4fddbe35-6f22-4968-bc7e-06cb27662d97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7305802-e1e6-46dc-a090-0748e35d748b", "name": "network-vif-plugged", "status": "completed", "tag": "ec839274-e8bb-48c3-bcdc-cc5833943b51"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:39:48.359945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-6d87b253-cfdf-478a-ac1c-b564cfb47cb2 req-4fddbe35-6f22-4968-bc7e-06cb27662d97 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:48.363134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-6d87b253-cfdf-478a-ac1c-b564cfb47cb2 req-4fddbe35-6f22-4968-bc7e-06cb27662d97 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:48.363134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-6d87b253-cfdf-478a-ac1c-b564cfb47cb2 req-4fddbe35-6f22-4968-bc7e-06cb27662d97 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:48.371399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-6d87b253-cfdf-478a-ac1c-b564cfb47cb2 req-4fddbe35-6f22-4968-bc7e-06cb27662d97 service nova] Creating event network-vif-plugged:ec839274-e8bb-48c3-bcdc-cc5833943b51 for instance f7305802-e1e6-46dc-a090-0748e35d748b on hv-cinder-85032 Aug 24 09:39:48.376832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-6d87b253-cfdf-478a-ac1c-b564cfb47cb2 req-4fddbe35-6f22-4968-bc7e-06cb27662d97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029812 Aug 24 09:39:48.377530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 616/1227] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:48.466593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:39:48.466875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:39:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:39:48.509877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:48.512078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:48.518500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:48.518983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:48.519420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:48.520605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:48.520605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:48.521036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:48.550753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a292b7c7-e6ef-48d2-8e0a-ee93d08234fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Aug 24 09:39:48.551307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 612/1228] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:48.797542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:48.801616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:48.804882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:48.805370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:48.805807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:48.806562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:48.807018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:48.807443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:48.934283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:48.936604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:48.945985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:48.945985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:48.946378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eab19b66-6e26-4c70-8335-03a79fb9b0d9 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1407 microversion: 2.20 time: 0.153236 Aug 24 09:39:48.946929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 617/1229] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:48 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:49.563383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:49.565543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:49.567359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=12 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:49.572585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:49.573069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:49.573531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:49.574226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:49.574677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:49.575102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:49.606474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-41c2ee36-771f-4499-8164-ecad8b46b532 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047507 Aug 24 09:39:49.607034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 613/1230] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:49.969140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:49.969752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:49.976499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:49.976976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:49.977407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:49.978097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:49.978556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:49.979065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:50.116901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:50.125776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:50.127316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:50.128471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-355a71ee-0782-4623-b784-4e49ac7e4418 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1407 microversion: 2.20 time: 0.163269 Aug 24 09:39:50.129025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 618/1231] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:49 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:50.618425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:50.620589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:50.627440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:50.627956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:50.628396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:50.629171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:50.629590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:50.630017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:50.659447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51e9d4c2-4493-4082-9134-c30a8fe94be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Aug 24 09:39:50.660020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 614/1232] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:51.150508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:51.151058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:51.157504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:51.157995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:51.158437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:51.159131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:51.159609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:51.160041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:51.288324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:51.297318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:51.298890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:39:51.300362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cfa7abc2-2d29-45a9-8e9d-9861b9f8d5a2 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1599 microversion: 2.20 time: 0.153919 Aug 24 09:39:51.301134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 619/1233] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:39:51 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:39:51.323245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:51.323852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:51.332910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:51.333809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:51.334411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:51.335289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:51.336045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:51.336496 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:51.412320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff18461e-ac4a-40db-a1ec-90e4afe01540 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093689 Aug 24 09:39:51.412910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 615/1234] 10.222.0.16 () {60 vars in 1316 bytes} [Wed Aug 24 09:39:51 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:39:51.671674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:51.673836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:51.679723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:51.680214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:51.680657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:51.681354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:51.681811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:51.682239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:51.712357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9070dd4b-d41e-4441-8193-4d955edab634 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044833 Aug 24 09:39:51.712910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 620/1235] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:52.715848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-5f7fcf45-ff89-402d-9cdf-9f24b0a04f87 req-b08874a5-a8da-4592-9538-83fb50557b58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7305802-e1e6-46dc-a090-0748e35d748b", "tag": "ec839274-e8bb-48c3-bcdc-cc5833943b51"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:39:52.724415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:52.725280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5f7fcf45-ff89-402d-9cdf-9f24b0a04f87 req-b08874a5-a8da-4592-9538-83fb50557b58 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:52.725756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5f7fcf45-ff89-402d-9cdf-9f24b0a04f87 req-b08874a5-a8da-4592-9538-83fb50557b58 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:52.726180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5f7fcf45-ff89-402d-9cdf-9f24b0a04f87 req-b08874a5-a8da-4592-9538-83fb50557b58 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:52.726566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:52.733054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:52.733544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:52.734486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:52.735208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:52.735714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:52.736134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:52.739219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-5f7fcf45-ff89-402d-9cdf-9f24b0a04f87 req-b08874a5-a8da-4592-9538-83fb50557b58 service nova] Creating event network-changed:ec839274-e8bb-48c3-bcdc-cc5833943b51 for instance f7305802-e1e6-46dc-a090-0748e35d748b on hv-cinder-85032 Aug 24 09:39:52.744374 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-5f7fcf45-ff89-402d-9cdf-9f24b0a04f87 req-b08874a5-a8da-4592-9538-83fb50557b58 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032814 Aug 24 09:39:52.744963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 616/1236] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:52.768064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-00c14080-5554-4b66-a206-1166d261c069 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047511 Aug 24 09:39:52.768618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 621/1237] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:53.781549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:53.783933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:53.790115 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:53.790670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:53.791196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:53.791983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:53.792508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:53.793007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:53.823076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b6372988-da7b-4585-b721-219db77680bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047004 Aug 24 09:39:53.823665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 617/1238] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:54.834616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:54.842990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:54.844121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:54.844600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:54.845080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:54.845761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:54.846208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:54.846628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:54.878041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e401b8aa-e287-4a23-a8f6-665aa66e829b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047448 Aug 24 09:39:54.878593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 622/1239] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:55.890798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:55.892955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:55.899287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:55.899807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:55.900244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:55.900930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:55.901386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:55.901809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:55.905456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:DELETE=2,nova_cell1:SELECT=94 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:39:55.930394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a50bb207-7a16-417b-a8fa-73658e23ea1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044107 Aug 24 09:39:55.930938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 618/1240] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:39:56.943005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:56.945171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:56.951849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:56.952335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:56.953633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:56.954331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:56.954788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:56.955215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:56.983898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7b1fb529-a001-4fa0-a488-154eb0832db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044996 Aug 24 09:39:56.984442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 623/1241] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:57.995895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:57.997935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:58.004556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:58.005032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:58.005467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:58.006150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:58.006598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:58.007021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:58.036072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5cff81fa-0b97-4d9c-89c6-e19d186f5621 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044541 Aug 24 09:39:58.036619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 619/1242] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:39:59.048818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:39:59.050944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:39:59.057569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:59.058020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:59.058451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:59.059128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:39:59.059574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:39:59.060019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:39:59.089406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-afee6fbd-a94b-4365-8741-da95a2d081e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045146 Aug 24 09:39:59.089942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 624/1243] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:39:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:00.101957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:00.109410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:00.111381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:00.112002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:00.112443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:00.113128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:00.113583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:00.114019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:00.150355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cbac8ac8-c1ef-4bd8-b7ff-4111cbee97d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052653 Aug 24 09:40:00.150915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 620/1244] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:01.162878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:01.165091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:01.171614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:01.172087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:01.172520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:01.173204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:01.173654 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:01.174082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:01.203248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b153d32c-b38f-490d-bbc6-aaa54a8db32c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Aug 24 09:40:01.203834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 625/1245] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:02.216353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:02.219273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:02.225907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:02.226390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:02.226826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:02.227513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:02.227999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:02.228428 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:02.260154 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d89a3e6-8c27-4754-9c6c-5084074e64a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047937 Aug 24 09:40:02.260989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 621/1246] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:40:03.272763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:03.274974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:03.281820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:03.282303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:03.282737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:03.283429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:03.283918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:03.284339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:03.316633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-26c32f20-4972-4c32-a464-edf6080afa66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047924 Aug 24 09:40:03.317191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 626/1247] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:04.329107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:04.331218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:04.337974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:04.338452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:04.338889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:04.339624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:04.340088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:04.340511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:04.368919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e171a537-19a7-4a72-8c94-0fb9a582faeb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Aug 24 09:40:04.369463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 622/1248] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:05.381357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:05.383540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:05.390478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:05.390966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:05.391410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:05.392136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:05.392597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:05.393024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:05.421443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f3e49ccb-41a1-42b3-b7fd-d04a96392970 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044115 Aug 24 09:40:05.421991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 627/1249] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:06.433774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:06.435972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:06.441905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:06.442388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:06.442829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:06.443522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:06.444005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:06.444438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:06.473812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d6fa5ad5-9ac1-4cd3-a436-5ad22ba5f2bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044236 Aug 24 09:40:06.474355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 623/1250] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:07.486522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:07.488626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:07.495067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:07.495548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:07.496025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:07.496715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:07.497182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:07.497611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:07.525899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e4e339d7-a475-477f-b5c1-874d45327a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Aug 24 09:40:07.526451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 628/1251] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:08.537601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:08.539795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:08.546161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:08.546636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:08.547569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:08.548269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:08.548714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:08.549135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:08.578567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1106605f-d4bf-4a41-8001-14682528c53d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044898 Aug 24 09:40:08.579133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 624/1252] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:09.590637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:09.592851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:09.600122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:09.600610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:09.601044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:09.601750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:09.602218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:09.602795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:09.632044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-79cb3750-14ce-4568-ba0f-8719e051ed56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045425 Aug 24 09:40:09.632592 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 629/1253] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:10.644296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:10.646469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:10.653042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:10.653520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:10.653954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:10.654644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:10.655097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:10.655521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:10.685202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-82f4ea55-4b96-478b-b2a9-e25985ee6367 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044766 Aug 24 09:40:10.685697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 625/1254] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:11.697898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:11.700165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:11.706434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:11.706906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:11.707334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:11.708048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:11.708497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:11.708910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:11.737517 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3c27c3cb-3af2-4bb1-8d5c-98f1842a2b3c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043613 Aug 24 09:40:11.738054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 630/1255] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:12.750852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:12.753094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:12.755604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=46 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:12.760298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:12.760785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:12.761223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:12.761909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:12.762367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:12.762793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:12.791817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff1b3698-4ca0-4258-8105-ad4016e8006b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045949 Aug 24 09:40:12.792499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 626/1256] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:13.804285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:13.806448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:13.810726 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=46 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:13.813966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:13.814441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:13.814876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:13.815575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:13.816087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:13.816461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:13.845957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9cbe2983-b7e8-400b-a493-c7a61f3c97ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Aug 24 09:40:13.846500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 631/1257] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:14.857833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:14.860498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:14.866822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:14.867301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:14.867771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:14.868462 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:14.868921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:14.869346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:14.897890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-39fd786b-3a73-49f6-be56-987e99fbf782 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044450 Aug 24 09:40:14.898445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 627/1258] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:40:15.910561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:15.912713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:15.918961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:15.919435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:15.919947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:15.920631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:15.921079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:15.921500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:15.950254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-33187db0-f9e5-4e0b-be8a-a978ec72441d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Aug 24 09:40:15.950796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 632/1259] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:16.963255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:16.965405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:16.972377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:16.972866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:16.973298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:16.973975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:16.974423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:16.974838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:17.002712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b7eeee22-bd68-404c-ae5d-c0568d83a8f0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Aug 24 09:40:17.003250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 628/1260] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:18.014969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:18.017056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:18.023189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:18.023693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:18.024129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:18.024843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:18.025290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:18.025709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:18.055761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4c6f98dd-a8c3-442c-878f-13be660ea078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044840 Aug 24 09:40:18.056301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 633/1261] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:19.068624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:19.070807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:19.077170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:19.077663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:19.078081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:19.078788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:19.079237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:19.079732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:19.108430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e830407e-0b30-4006-8e38-abc9535e5231 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043886 Aug 24 09:40:19.109478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 629/1262] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:20.121396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:20.123479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:20.130404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:20.130923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:20.131351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:20.132101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:20.134446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:20.134446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:20.135299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:20.162674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c1601a6d-4d54-452e-8652-3a1e11260bb3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045415 Aug 24 09:40:20.163213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 634/1263] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:21.174972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:21.177043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:21.183296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:21.183811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:21.184245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:21.184922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:21.185372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:21.185786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:21.214899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-26a0fca6-1406-4257-a31b-73eaaaa5d6ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043948 Aug 24 09:40:21.215431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 630/1264] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:22.227014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:22.229084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:22.236394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:22.236865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:22.237294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:22.237967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:22.238413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:22.238832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:22.267629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6a7af727-d4b3-435d-8d68-74205e262ccf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Aug 24 09:40:22.268180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 635/1265] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:23.279500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:23.281724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:23.288171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:23.288655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:23.289094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:23.289782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:23.290237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:23.290662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:23.319527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-25ee065a-c66b-4044-8936-19e4682150f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Aug 24 09:40:23.320101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 631/1266] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:24.331848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:24.333910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:24.340466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:24.340976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:24.341435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:24.342122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:24.342571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:24.342993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:24.381025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7f2c8e29-4402-4422-b60d-fcca97c5b276 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053205 Aug 24 09:40:24.381580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 636/1267] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:25.394249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:25.396396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:25.402720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:25.403201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:25.403665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:25.404353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:25.404809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:25.405241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:25.433252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68620c95-ad32-4e8d-a9c1-c03b8a37cce8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043765 Aug 24 09:40:25.433786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 632/1268] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:26.445217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:26.447331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:26.454332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:26.454812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:26.455245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:26.455970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:26.456427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:26.456853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:26.485693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4799f224-b84f-41bb-8f57-c9b79e1d0583 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044545 Aug 24 09:40:26.486232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 637/1269] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:27.498175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:27.500298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:27.506583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:27.507057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:27.507486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:27.508189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:27.508639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:27.509058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:27.538175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b9a692fe-a88d-40c7-b39e-1f2123a983de tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Aug 24 09:40:27.538714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 633/1270] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:28.550822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:28.553033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:28.559477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:28.559993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:28.560435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:28.561123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:28.561578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:28.562006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:28.590621 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f6bf58eb-7b53-44d7-9f97-ed518763cad6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044351 Aug 24 09:40:28.591171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 638/1271] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:29.603090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:29.605201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:29.612281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:29.612760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:29.613191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:29.613876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:29.614329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:29.614751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:29.639992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:29.644917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6f4bbd54-09a4-475b-9e66-0086680c4dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045811 Aug 24 09:40:29.645494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 634/1272] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:30.657459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:30.659606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:30.665968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:30.666454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:30.666897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:30.667697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:30.668158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:30.668589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:30.697476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-02ded5f4-ba2e-4759-9bfa-2e83ec17a44c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044438 Aug 24 09:40:30.698031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 639/1273] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:31.710166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:31.712558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:31.720232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:31.720714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:31.721152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:31.721850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:31.722316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:31.722749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:31.751018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-824d0d21-a210-457d-93d4-424d16d0f8ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044902 Aug 24 09:40:31.751593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 635/1274] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:32.762823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:32.765014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:32.771879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:32.772362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:32.773181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:32.773628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:32.774088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:32.774525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:32.804091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8b77f59e-7fea-4646-9e42-72ec78f7dde2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Aug 24 09:40:32.804643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 640/1275] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:33.816560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:33.818709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:33.825318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:33.825805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:33.826244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:33.826943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:33.827400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:33.827870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:33.857996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-205106c3-a499-489b-8b93-e469da12cd34 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045805 Aug 24 09:40:33.858549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 636/1276] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:34.870229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:34.872455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:34.878699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:34.879176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:34.879633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:34.880322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:34.880775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:34.881199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:34.911185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-79d9d284-3210-478c-a428-c251b7bd40ba tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045005 Aug 24 09:40:34.911766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 641/1277] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:35.923244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:35.925429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:35.931773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:35.932256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:35.932694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:35.933389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:35.933839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:35.934266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:35.964183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-416690cb-20ff-4385-a228-c472d9f42318 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Aug 24 09:40:35.964730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 637/1278] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:36.976054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:36.978193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:36.984500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:36.984979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:36.985412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:36.986099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:36.986557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:36.986982 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:37.014934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-63735c83-036c-4e26-a799-3ee38808dc24 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042966 Aug 24 09:40:37.016015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 642/1279] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:38.027608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:38.029776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:38.036249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:38.036731 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:38.037170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:38.037861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:38.038324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:38.038776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:38.067873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a02045f6-eeb5-4325-a1de-7e028de16dc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Aug 24 09:40:38.068421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 638/1280] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:39.080021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:39.082168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:39.089038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:39.089520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:39.089961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:39.090654 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:39.091111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:39.091537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:39.122104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-da5cd5aa-9783-46b0-9d44-57d59fa919a3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046082 Aug 24 09:40:39.122674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 643/1281] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:40:40.134443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:40.136669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:40.143026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:40.143506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:40.144046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:40.144735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:40.145190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:40.145685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:40.174498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ad2778d3-20b4-42fa-b788-46cb02d47a54 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043942 Aug 24 09:40:40.175039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 639/1282] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:41.186218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:41.188416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:41.194675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:41.195165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:41.195626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:41.196320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:41.196773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:41.197202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:41.226319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bf45777b-ec8c-4146-b66f-b971c371c4d8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044046 Aug 24 09:40:41.226857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 644/1283] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:42.238336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:42.240478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:42.247142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:42.247802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:42.248271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:42.248993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:42.249449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:42.249877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:42.278890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-830ebee8-f534-42bc-9237-59db398e9a16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044581 Aug 24 09:40:42.279433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 640/1284] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:43.291914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:43.294105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:43.301579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:43.302064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:43.302499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:43.303198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:43.303679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:43.304588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:43.333779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ca8a7a48-b808-44ad-bdfc-03dad0519db1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045964 Aug 24 09:40:43.334350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 645/1285] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:44.346361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:44.348554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:44.355078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:44.355556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:44.356021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:44.356705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:44.357159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:44.357583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:44.386128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4b7fab55-e778-4643-98ca-76ec4ca796be tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043774 Aug 24 09:40:44.386669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 641/1286] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:45.398613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:45.400803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:45.407342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:45.408478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:45.408916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:45.409600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:45.410049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:45.410472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:45.439038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f29ebcbf-87e9-4c58-a2a6-1e3f7ff83204 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044344 Aug 24 09:40:45.439599 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 646/1287] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:46.450340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:46.452545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:46.455530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=32 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:46.457067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:46.457491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:46.459515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=32 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:46.461841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:46.462335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:46.462775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:46.463484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:46.463969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:46.464389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:46.464532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:46.464867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:46.465301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:46.465991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:46.466439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:46.466926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:46.491802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:40:46.493965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-452ae5cd-fe98-4625-b248-e0b457c0e4bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047514 Aug 24 09:40:46.494535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 642/1288] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:46.825170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9142c3b2-c133-4014-b9a0-45eef9a3ead5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 204 len: 0 microversion: 2.1 time: 0.373067 Aug 24 09:40:46.825690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 647/1289] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:40:46 2022] DELETE /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:40:46.833879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:46.834495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:46.840601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:46.841081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:46.841516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:46.842204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:46.843050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:46.843477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:46.977724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:40:46.986429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-10fc30ea-7e59-47cb-9d85-7c6c31256037 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1690 microversion: 2.1 time: 0.156059 Aug 24 09:40:46.986991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 643/1290] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:40:46 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:40:47.506544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:47.508802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:47.515099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:47.515609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:47.516049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:47.516740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:47.517716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:47.518143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:47.547498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b5b32465-5b14-4cac-9fe2-087dabfb4dc6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Aug 24 09:40:47.548092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 648/1291] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:48.007806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:48.008431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:48.014759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:48.015244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:48.015781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:48.016479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:48.017523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:48.017957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:48.262914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:40:48.271037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-46ff94ff-4001-448e-89a0-96f40f397657 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1690 microversion: 2.1 time: 0.267170 Aug 24 09:40:48.271626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 644/1292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:40:48 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1690 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:40:48.559207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:48.561468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:48.567468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:48.567987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:48.568423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:48.569109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:48.569559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:48.569979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:48.572512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:40:48.601363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-75133c42-bdce-4878-a473-3a49e9df6a09 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046047 Aug 24 09:40:48.602025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 649/1293] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:48.817464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-9a78fa16-dbc6-4ebb-ad57-b27e420062c8 req-62a084c2-b399-455a-91fd-e8305642fe56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e147f8-b859-4bd1-bb4e-568041201520", "name": "network-vif-deleted", "tag": "f7a0b684-ee3d-4463-a53a-01d76f4dfaac"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:40:48.827327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9a78fa16-dbc6-4ebb-ad57-b27e420062c8 req-62a084c2-b399-455a-91fd-e8305642fe56 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:48.827889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9a78fa16-dbc6-4ebb-ad57-b27e420062c8 req-62a084c2-b399-455a-91fd-e8305642fe56 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:48.828321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9a78fa16-dbc6-4ebb-ad57-b27e420062c8 req-62a084c2-b399-455a-91fd-e8305642fe56 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:48.840886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-9a78fa16-dbc6-4ebb-ad57-b27e420062c8 req-62a084c2-b399-455a-91fd-e8305642fe56 service nova] Creating event network-vif-deleted:f7a0b684-ee3d-4463-a53a-01d76f4dfaac for instance f2e147f8-b859-4bd1-bb4e-568041201520 on hv-cinder-85032 Aug 24 09:40:48.846772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-9a78fa16-dbc6-4ebb-ad57-b27e420062c8 req-62a084c2-b399-455a-91fd-e8305642fe56 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090661 Aug 24 09:40:48.847673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 645/1294] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:40:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:49.291809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:49.292450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:49.299448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:49.300185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:49.300839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:49.301547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:49.302202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:49.302805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:49.334966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:49.335738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:49.336178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:49.336632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lazy-loading 'fault' on Instance uuid f2e147f8-b859-4bd1-bb4e-568041201520 {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:40:49.382522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:40:49.390536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-525cdc1f-6adc-40b5-ac00-893b59ccce6b tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 200 len: 1425 microversion: 2.1 time: 0.102697 Aug 24 09:40:49.391151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 650/1295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:40:49 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 1425 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:40:49.614994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:49.617367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:49.624530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:49.625078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:49.625520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:49.626226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:49.626680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:49.627398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:49.659356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-faa9ba8b-bdcd-4d92-b1fa-45afc9104003 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049442 Aug 24 09:40:49.659958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 646/1296] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:50.414256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:50.414871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: f2e147f8-b859-4bd1-bb4e-568041201520] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:50.421272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:50.421754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:50.422192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:50.422883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:50.423866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:50.424296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:50.437467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] HTTP exception thrown: Instance f2e147f8-b859-4bd1-bb4e-568041201520 could not be found. Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Request method failure captured: Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 HTTP/1.1 Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe-TECnAWFRqk2BJPqP2-p2HZ2FIj0WbaJcg1hsSoR_01ATvBuGQsE333CvTIF8qCC0WCHeY5-ncjWowna-FLVg79rgVXhG6K2RKGz0YWWlGzvC_O_G9ojDislDHFa_l6hBwzvYWFCYNDcoLSkGsGJ_BAfxairf-5mWS-TLdNMROQLs Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:40:50.439724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a0a723d97d24385875a287252f57f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a0a723d97d24385875a287252f57f02", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 0aff36cf71984238b8a9b998043ec7be Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance f2e147f8-b859-4bd1-bb4e-568041201520 could not be found. Aug 24 09:40:50.441444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'f2e147f8-b859-4bd1-bb4e-568041201520'} Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e147f8-b859-4bd1-bb4e-568041201520 could not be found. Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:40:50.442461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e147f8-b859-4bd1-bb4e-568041201520 could not be found. Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e147f8-b859-4bd1-bb4e-568041201520 could not be found. Aug 24 09:40:50.443955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:40:50.445419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Returning 404 to user: Instance f2e147f8-b859-4bd1-bb4e-568041201520 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:40:50.445419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ce9a0551-1fa5-4d8e-b130-ff0d21774220 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520" status: 404 len: 111 microversion: 2.1 time: 0.030760 Aug 24 09:40:50.445419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 651/1297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:40:50 2022] GET /compute/v2.1/servers/f2e147f8-b859-4bd1-bb4e-568041201520 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:40:50.449803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3abb4eee-0594-48d5-9183-2616e2549e26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '.version_select at 0x7fa91809e9d0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:50.543217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3abb4eee-0594-48d5-9183-2616e2549e26 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797110528" status: 202 len: 0 microversion: 2.1 time: 0.097252 Aug 24 09:40:50.543819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 647/1298] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Aug 24 09:40:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1797110528 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:40:50.671671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:50.673968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:50.679877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:50.680355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:50.680791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:50.681479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:50.681933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:50.682398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:50.711357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4781ae87-5b07-4a30-8660-0c874ca67b3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Aug 24 09:40:50.717171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 652/1299] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:51.724806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:51.726975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:51.733860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:51.734337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:51.734767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:51.735454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:51.735931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:51.736355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:51.765331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-77012037-9a9c-4afe-91dd-e426889ac4b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045675 Aug 24 09:40:51.765891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 648/1300] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:52.778101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:52.780285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:52.787323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:52.787846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:52.788290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:52.788980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:52.789438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:52.789870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:52.818146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6ab4a456-e3e1-4ee9-a3cc-6cf838cd1e01 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043979 Aug 24 09:40:52.818686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 653/1301] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:53.829724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:53.831874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:53.839529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:53.840043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:53.840480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:53.841173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:53.841629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:53.842057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:53.871284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fdb20e0b-ee58-4334-93fc-f121dd3c2edb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Aug 24 09:40:53.871869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 649/1302] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:54.884266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:54.886411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:54.893279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:54.893799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:54.894228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:54.894915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:54.895362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:54.895816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:54.927363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-994e994a-b41a-4e52-b2fb-ad81ab69f30c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047804 Aug 24 09:40:54.927939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 654/1303] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:40:55.939981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:55.942121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:55.948495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:55.948974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:55.949408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:55.950089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:55.950537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:55.950957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:55.979382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8f8ee408-df78-45c8-aa8d-f70c61d1f834 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043880 Aug 24 09:40:55.979962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 650/1304] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:56.990901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:40:56.993121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:56.999550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:57.000053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:57.000489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:57.001715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:57.002168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:57.002586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:57.031196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0eb2d3ea-b63b-478f-b50c-317c61a7a549 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044157 Aug 24 09:40:57.031766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 655/1305] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 09:40:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:40:58.042333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:40:58.044542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:40:58.050839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:58.051320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:58.051796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:58.052484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:40:58.052939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:40:58.053364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:40:58.164285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eaf83783-419c-4d74-8e83-e704d9194838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/action" status: 200 len: 41264 microversion: 2.1 time: 0.125558 Aug 24 09:40:58.164935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 651/1306] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Aug 24 09:40:58 2022] POST /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d/action => generated 41264 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:41:07.786458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:41:07.786997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:41:07.789389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:07.790193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=39 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:41:07.794616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:41:07.795089 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:41:07.795520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:41:07.796224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:41:07.796678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:41:07.797098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:41:07.819211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3879ea89-e342-4253-bf61-e399ee22dc73 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b/ips" status: 200 len: 151 microversion: 2.20 time: 0.037145 Aug 24 09:41:07.819694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 656/1307] 10.222.0.16 () {60 vars in 1289 bytes} [Wed Aug 24 09:41:07 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 24 09:41:21.442116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:41:21.442753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:41:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:43:08.476499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:43:08.477023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:43:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:43:10.076682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 24 09:43:10.077349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:43:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:43:23.018829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:43:23.019388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:43:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:43:40.879345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:43:40.879345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:43:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:43:56.855760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 09:43:56.859767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:56.859767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=90 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:43:56.861410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:43:56.861998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:43:56.868851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:56.869334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:56.869775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:56.870466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:56.870925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:56.871356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:56.896440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:43:57.169171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0a822af6-d6f1-44be-b860-dd0a1ae28efc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "DELETE /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 204 len: 0 microversion: 2.1 time: 0.314946 Aug 24 09:43:57.169787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 652/1308] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:43:56 2022] DELETE /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:43:57.176514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 09:43:57.180673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:43:57.181373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:43:57.187808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:57.188286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:57.188719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:57.189480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:57.189981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:57.190359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:57.478215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:43:57.486425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0999af70-556a-478a-9ae7-6e966388c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.312388 Aug 24 09:43:57.486980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 657/1309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:43:57 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:43:58.508672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:43:58.509388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:43:58.518299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:58.518789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:58.519239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:58.519962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:58.520427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:58.520863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:58.527077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59224. Aug 24 09:43:58.711611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:43:58.719811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6dc90608-8085-4780-90ed-991578a0792e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.215371 Aug 24 09:43:58.720361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 653/1310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:43:58 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:43:59.741021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:43:59.741633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:43:59.749252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:59.749774 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:59.750234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:59.750927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:43:59.751380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:43:59.751833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:43:59.768636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 59248. Aug 24 09:43:59.881027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:43:59.889175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9ff1cfc5-0d33-4bc6-83e4-ba962078b444 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152006 Aug 24 09:43:59.889731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 658/1311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:43:59 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:00.910670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:00.911223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:00.918322 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:00.918796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:00.919239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:00.919976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:00.920450 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:00.920864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:01.052569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:01.061049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5b0ab409-7213-4990-8d32-78b30241499e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154421 Aug 24 09:44:01.061606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 654/1312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:00 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:02.082281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:02.082877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:02.089561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:02.090039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:02.090469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:02.091147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:02.091609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:02.092539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:02.216163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:02.224667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-102853b0-a80b-4ceb-8596-b8a585b934df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146250 Aug 24 09:44:02.225222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 659/1313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:02 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:03.245923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:03.246487 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:03.253422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:03.253898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:03.254327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:03.255003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:03.255452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:03.255895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:03.382092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:03.390128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1cb05ae-e812-4034-91a4-5e7871c64ab3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148200 Aug 24 09:44:03.390694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 655/1314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:03 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:04.411063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:04.411711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:04.418049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:04.418534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:04.418976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:04.419702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:04.420162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:04.420589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:04.548203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:04.557077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2b4a93a3-c3fc-4cc9-9d19-a841727c029b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149846 Aug 24 09:44:04.557571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 660/1315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:04 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:05.578411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:05.578952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:05.585601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:05.586071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:05.586763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:05.587445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:05.588033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:05.588464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:05.716523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:05.725537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5581b627-be47-41b6-9a43-d550f3d4ee1d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151061 Aug 24 09:44:05.726098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 656/1316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:05 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:06.746102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:06.746720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:06.753645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:06.754126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:06.754568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:06.755265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:06.755756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:06.756178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:06.884957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:06.893180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e94ceb11-5186-4ea7-be26-93b2b9d556df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150968 Aug 24 09:44:06.893738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 661/1317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:06 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:07.913762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:07.914371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:07.920763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:07.921664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:07.921664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:07.922320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:07.922768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:07.923186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:08.053909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:08.061928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a2d4e145-1864-4bdc-83d0-c7857c687ef3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151950 Aug 24 09:44:08.062500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 657/1318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:07 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:09.083128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:09.083817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:09.090429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:09.090926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:09.091340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:09.092747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:09.093228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:09.093703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:09.234683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:09.243209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-01ad7bfb-5d92-42e4-9f69-8dc46c67ebd7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.163985 Aug 24 09:44:09.252359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 662/1319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:09 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:10.263985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:10.264466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:10.270757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:10.271242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:10.271720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:10.272418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:10.272880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:10.273319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:10.401855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:10.410497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2bf4e07d-0d8f-45c9-aee8-d0cea94a63e1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150699 Aug 24 09:44:10.411006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 658/1320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:10 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:11.431838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:11.432463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:11.439017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:11.439499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:11.439978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:11.440765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:11.441213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:11.441632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:11.572144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:11.580841 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f2950e79-e0df-4232-a1b1-667239663804 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153077 Aug 24 09:44:11.581399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 663/1321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:11 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:12.601988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:12.602597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:12.608833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:12.609309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:12.609740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:12.610422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:12.610867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:12.611285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:12.741455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:12.750121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-70b0f0c4-e512-4ab2-b657-c927a74a9a46 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151969 Aug 24 09:44:12.750678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 659/1322] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:12 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:13.773169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:13.774052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:13.781048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:13.781527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:13.781962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:13.782681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:13.783132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:13.783556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:13.909324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:13.917375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-70d005d6-60dc-4e5b-bf25-47ebd9add5e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148184 Aug 24 09:44:13.917929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 664/1323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:13 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:14.938355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:14.939151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:14.945689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:14.949770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:14.949770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:14.949770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:14.949770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:14.950206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:15.178648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:15.187281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ddcb8607-dfbe-48d2-83ee-11e8d4207b73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.252685 Aug 24 09:44:15.187951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 660/1324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:14 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:16.211508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:16.211508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:16.215283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:16.215832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:16.216311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:16.217551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:16.218034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:16.218458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:16.571876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:16.581657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-54094c44-224c-415d-8f82-88dd42e2b423 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.377622 Aug 24 09:44:16.582237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 665/1325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:16 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:17.602068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:17.604710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:17.609772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:17.610291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:17.610697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:17.611394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:17.611903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:17.612333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:17.745257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:17.753654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d99e9208-0d20-476d-b147-5ff681ae0c4d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155404 Aug 24 09:44:17.754223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 661/1326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:17 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:18.774249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:18.774876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:18.781297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:18.781779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:18.782219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:18.782909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:18.783369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:18.783823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:18.909320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:18.917443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-773edece-88b8-4618-a463-b2558cb92d71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147079 Aug 24 09:44:18.918009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 666/1327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:18 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:19.938313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:19.938921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:19.945426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:19.945898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:19.946329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:19.947003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:19.947450 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:19.947907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:20.073365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:20.081417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d6d69ffe-d8f0-4f32-a041-4eef01d4a64e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146974 Aug 24 09:44:20.081976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 662/1328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:19 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:21.108114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:21.109278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:21.118449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:21.118932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:21.119370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:21.120103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:21.120557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:21.120979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:21.249517 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:21.257611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c1112b28-3c01-4371-8b2e-8e168754b2cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.157429 Aug 24 09:44:21.258168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 667/1329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:21 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:22.278216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:22.278827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:22.285364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:22.285851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:22.286288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:22.286980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:22.287436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:22.287899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:22.411376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:22.419697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-14f6c83f-c614-4453-aa43-b6dd684fbb5c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.145271 Aug 24 09:44:22.420267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 663/1330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:22 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:23.444402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:23.445063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:23.452259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:23.452738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:23.453170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:23.453898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:23.454344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:23.454767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:23.586659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:23.593829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-68234a48-4fb7-44c3-97e4-5aea262cda29 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153316 Aug 24 09:44:23.594652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 668/1331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:23 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:24.614988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:24.615642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:24.622012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:24.622505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:24.622934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:24.623645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:24.624101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:24.624527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:24.755513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:24.764158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4d7e5b49-da98-4aec-bfeb-36c4c70611df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152461 Aug 24 09:44:24.764723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 664/1332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:24 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:25.785287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:25.785930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:25.792324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:25.792800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:25.793249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:25.793912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:25.794358 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:25.795296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:25.924552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:25.932635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d600852a-5dae-4651-904f-ee82f873bee4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151272 Aug 24 09:44:25.933193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 669/1333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:25 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:26.953904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:26.954552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:26.961276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:26.963126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:26.963126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:26.963126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:26.963444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:26.964200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:27.096124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:27.097440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:27.105970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1c95b8a1-d23b-4aa1-8c04-db1feb9a2e93 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156426 Aug 24 09:44:27.106661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 665/1334] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:26 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:28.127452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:28.128225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:28.130393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=29 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:28.135714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:28.136199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:28.136638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:28.137336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:28.137786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:28.138211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:28.141499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=83 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:28.269168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:28.277802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e7f56790-c429-4217-a8cb-26b34eca084a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154181 Aug 24 09:44:28.278360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 670/1335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:28 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:29.298718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:29.299332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:29.301516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:29.306649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:29.307129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:29.307558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:29.308277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:29.308779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:29.309201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:29.683854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:29.692406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f5dc4a09-f013-4c71-86aa-478aa2e74f37 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.398153 Aug 24 09:44:29.692970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 666/1336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:29 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:30.714112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:30.714730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:30.721273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:30.721750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:30.722182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:30.722865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:30.723316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:30.723766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:30.849409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:30.858241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c73613f7-ce72-4b3e-90be-f0cab5f7efde tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148379 Aug 24 09:44:30.858816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 671/1337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:30 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:31.879527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:31.880243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:31.886569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:31.887046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:31.887480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:31.888191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:31.888646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:31.889072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:32.019711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:32.028020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4f425721-6f01-4ce9-ae5c-492533d0311d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152296 Aug 24 09:44:32.028573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 667/1338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:31 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:33.049881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:33.050543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:33.056912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:33.057393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:33.057832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:33.058553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:33.059008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:33.059434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:33.188063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:33.196303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-209c975e-a162-4d86-93fd-9bb240beb5bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150173 Aug 24 09:44:33.196835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 672/1339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:33 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:44:34.216821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:34.217429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:34.223748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:34.224308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:34.224737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:34.225424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:34.225873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:34.226297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:34.354216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:34.362972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b08fd632-3077-44ac-8254-1b8b6fe8890f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150450 Aug 24 09:44:34.363534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 668/1340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:34 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:35.383764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:35.384315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:35.390645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:35.391124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:35.391560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:35.392270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:35.392721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:35.393174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:35.518915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:35.527226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6fdce1d8-a84e-4fb3-9279-061e56fd9c87 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147408 Aug 24 09:44:35.527914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 673/1341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:35 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:36.548089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:36.548738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:36.555082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:36.555562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:36.556037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:36.556722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:36.557176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:36.557600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:36.695171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:36.704798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4bfbd6bc-51a0-4d10-b1f9-68109a027529 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.160487 Aug 24 09:44:36.705680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 669/1342] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:36 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:37.725765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:37.726378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:37.732691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:37.733171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:37.733601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:37.734284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:37.734730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:37.735156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:37.863975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:37.872187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e27ff94c-8383-4ba2-9e93-bf75d36366f7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150240 Aug 24 09:44:37.873198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 674/1343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:37 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:38.893228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:38.893841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:38.900181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:38.900661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:38.901096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:38.901782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:38.902236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:38.902663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:39.033610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:39.041702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b47ef8cd-35ea-4a53-80f2-3f01fb450ac4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152303 Aug 24 09:44:39.042261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 670/1344] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:38 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:40.062470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:40.063091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:40.069560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:40.070044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:40.070488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:40.071180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:40.071661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:40.072091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:40.198433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:40.206681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9249daa2-5e6a-43d2-a275-82e512b46333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148749 Aug 24 09:44:40.207239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 675/1345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:40 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:41.228395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:41.228981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:41.235802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:41.236276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:41.236706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:41.237384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:41.237833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:41.238252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:41.366550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:41.375549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b2a8b2d1-1017-448f-95d5-7401387778a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151054 Aug 24 09:44:41.376152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 671/1346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:41 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:41.450176 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:44:41.451131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:44:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:44:42.396544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:42.397165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:42.403600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:42.404103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:42.404545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:42.405237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:42.405694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:42.406125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:42.537056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:42.545196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-645bff32-247e-4507-b0ad-36cfd0b75cc8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152536 Aug 24 09:44:42.545760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 676/1347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:42 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:43.565895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:43.566512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:43.573077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:43.573566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:43.574003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:43.574698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:43.575155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:43.576111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:43.701898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:43.710452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7e790bae-342a-4332-8acb-b1f7102dc59b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148338 Aug 24 09:44:43.711029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 672/1348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:43 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:44.730490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:44.731098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:44.737562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:44.738033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:44.738463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:44.739143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:44.739607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:44.740030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:44.866768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:44.876910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-413a731d-783c-48e2-9c72-5c15c37436aa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150275 Aug 24 09:44:44.877472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 677/1349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:44 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:45.898380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:45.898950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:45.906006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:45.906484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:45.906921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:45.907631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:45.908087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:45.908512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:46.038188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:46.046417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3019da30-66fc-4312-b7db-e4c284491e17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152016 Aug 24 09:44:46.046982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 673/1350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:45 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:47.067231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:47.067900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:47.074237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:47.074725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:47.075165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:47.075880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:47.076335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:47.076759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:47.206919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:47.223947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ad4fb56e-6dc2-457a-b36c-3486c6cc564f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.160513 Aug 24 09:44:47.224514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 678/1351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:47 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:48.245414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:48.246034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:48.252915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:48.253398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:48.253837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:48.254523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:48.254976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:48.255399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:48.387401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:48.396164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6f1dd051-752c-4e8d-8af1-7cde16edf26f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154225 Aug 24 09:44:48.396743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 674/1352] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:48 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:49.420039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:49.420690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:49.427021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:49.427499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:49.427968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:49.428651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:49.429137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:49.429536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:49.560739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:49.569642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bf13b3b2-7984-4ed6-b1b1-137cc7b85ed0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155869 Aug 24 09:44:49.570204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 679/1353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:49 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:50.590662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:50.591205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:50.598217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:50.598697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:50.599162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:50.599879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:50.600335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:50.600762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:50.730414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:50.743344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-89eb9fce-32c4-42e1-ac9c-af6d14db6ae5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156617 Aug 24 09:44:50.743931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 675/1354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:50 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:50.951192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:44:50.952303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:44:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:44:51.765660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:51.766273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:51.772974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:51.773451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:51.773883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:51.774563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:51.775010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:51.775430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:51.904415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:51.913354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2638f6e0-9292-4676-b780-b8798513dc85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152033 Aug 24 09:44:51.913952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 680/1355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:51 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:44:52.934211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:52.934829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:52.941931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:52.942408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:52.942838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:52.943518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:52.943992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:52.944413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:53.072772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:53.081497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a0317927-de17-45d9-8f6a-22f93a2e983b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151114 Aug 24 09:44:53.082064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 676/1356] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:52 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:54.102182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:54.102804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:54.109182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:54.109662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:54.110099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:54.110791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:54.111249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:54.111712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:54.242052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:54.250665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fbd08cc4-17f3-411b-a2c2-a1cd602b92b4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152285 Aug 24 09:44:54.251224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 681/1357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:54 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:55.271973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:55.272581 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:55.278998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:55.279505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:55.279975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:55.280661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:55.281107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:55.281537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:55.408681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:55.417119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c45ba5a9-72c6-49fa-b6b3-72dac0a39ffc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149474 Aug 24 09:44:55.417688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 677/1358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:55 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:56.438280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:56.439566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:56.446322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:56.446805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:56.447246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:56.447977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:56.448492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:56.448907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:56.573230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:56.581848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ba4d72c7-0cf4-4df4-bec9-b14beb503c10 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147327 Aug 24 09:44:56.582413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 682/1359] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:56 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:57.603078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:57.603718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:57.610758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:57.611234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:57.611697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:57.612377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:57.612825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:57.613242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:57.745353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:57.753392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-382faf1e-bc3a-43e3-8724-d9bcef14f582 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154141 Aug 24 09:44:57.754138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 678/1360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:57 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:58.774949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:58.775759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:58.779907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=26 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:58.784121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:58.784602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:58.785031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:58.785761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:58.786208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:58.786628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:58.789363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=78 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:58.913805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:44:58.921932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-14e861b4-b23f-4d29-9323-5d9ebe0235b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151556 Aug 24 09:44:58.922497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 683/1361] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:58 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:44:59.942819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:44:59.943483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:44:59.946386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=26 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:44:59.949754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:59.950231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:59.950657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:59.951929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:44:59.952379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:44:59.952799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:44:59.956789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=80 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:00.085219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:00.093341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2eb697a2-391a-4db4-9759-ef3d13cb1690 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154830 Aug 24 09:45:00.093906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 679/1362] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:44:59 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:01.114179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:01.114802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:01.124920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:01.124920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:01.124920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:01.124920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:01.125297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:01.125297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:01.252227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:01.260342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4895d80f-bf56-4413-8fcb-722ed90102ac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150072 Aug 24 09:45:01.260911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 684/1363] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:01 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:02.281142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:02.281760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:02.288260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:02.288744 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:02.289181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:02.289868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:02.290323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:02.290751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:02.424310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:02.432470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-54ca9ce0-6ff5-4405-96f7-b24c8ccc8155 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155095 Aug 24 09:45:02.433065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 680/1364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:02 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:03.454118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:03.454845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:03.465571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:03.468236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:03.468236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:03.468236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:03.468236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:03.468719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:03.600950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:03.609173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3b754e4d-2d7c-419b-8ff5-9bb211834a62 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.159426 Aug 24 09:45:03.609777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 685/1365] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:03 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:04.630735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:04.631382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:04.637624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:04.638099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:04.638532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:04.639208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:04.639781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:04.640208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:04.766297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:04.774480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-700fa3a5-045d-4899-ae3c-ede9bca74ec1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147515 Aug 24 09:45:04.775045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 681/1366] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:04 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:05.795895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:05.796517 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:05.802891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:05.803366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:05.803831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:05.804518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:05.804970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:05.805396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:05.932750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:05.941401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f66f057f-13f9-4842-b91e-7b6bd2337144 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149453 Aug 24 09:45:05.941963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 686/1367] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:05 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:06.962651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:06.963186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:06.970377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:06.973130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:06.973130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:06.973130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:06.973130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:06.973513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:07.110533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:07.119452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-96d75efd-ada1-47ff-9a10-aea15c36f8d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.160949 Aug 24 09:45:07.120056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 682/1368] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:06 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:08.140508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:08.141669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:08.148126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:08.148607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:08.149047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:08.149730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:08.150183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:08.150606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:08.277272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:08.285569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-97a186e1-c3aa-4e41-94cb-41992e419bdf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148959 Aug 24 09:45:08.299293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 687/1369] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:08 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:09.306502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:09.307122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:09.314063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:09.314545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:09.314984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:09.315701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:09.316158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:09.316582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:09.445324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:09.454108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8c114c7a-2f84-4ba9-9c70-89a40b0adf2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150829 Aug 24 09:45:09.454671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 683/1370] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:09 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:10.486678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:10.487328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:10.493716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:10.494201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:10.494645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:10.495340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:10.495829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:10.496260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:10.628870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:10.661901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-daebbe42-6bf0-451c-8ede-cf26953aa378 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154615 Aug 24 09:45:10.661901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 688/1371] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:10 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:11.681678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:11.682252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:11.689004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:11.689485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:11.689918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:11.690620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:11.691063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:11.691488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:11.817162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:11.825209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-20bb355c-5104-4954-8caa-85fa0b40322a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147419 Aug 24 09:45:11.825774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 684/1372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:11 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:12.846807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:12.847427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:12.853847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:12.854335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:12.854769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:12.855466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:12.855956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:12.856381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:12.982063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:12.990913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0967fb3f-ade5-43d3-8f2a-763831a87333 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148593 Aug 24 09:45:12.991486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 689/1373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:12 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:14.012404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:14.013038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:14.020102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:14.020590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:14.021036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:14.021733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:14.022194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:14.022624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:14.153498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:14.161553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-12f6eef2-76c5-4580-b30c-6de7eae32614 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152962 Aug 24 09:45:14.162044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 685/1374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:14 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:15.182301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:15.182912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:15.189537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:15.190202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:15.190758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:15.191453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:15.191930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:15.192346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:15.322777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:15.331410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5a020a98-a671-45c4-8fad-5b3a9c38cf7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152890 Aug 24 09:45:15.335620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 690/1375] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:15 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:16.352841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:16.353486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:16.360649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:16.361129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:16.361564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:16.362249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:16.362704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:16.363151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:16.492805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:16.501037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-754d2f13-c3b9-418e-8e5f-14c9da4f6ede tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152062 Aug 24 09:45:16.501608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 686/1376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:16 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:17.522550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:17.523081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:17.529373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:17.529848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:17.530277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:17.530957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:17.532023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:17.532444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:17.661970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:17.670094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-87af03ec-2b8f-4746-9261-d1878676cbfa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151506 Aug 24 09:45:17.670652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 691/1377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:17 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:18.691605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:18.692243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:18.698959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:18.699438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:18.699900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:18.700680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:18.701130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:18.701622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:18.838265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:18.842484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-88e17ef6-849e-4911-ba9c-f9f3ddeba9af tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154787 Aug 24 09:45:18.843050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 687/1378] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:18 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:19.864714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:19.865326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:19.871792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:19.872263 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:19.872693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:19.873459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:19.873938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:19.874362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:20.011101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:20.019262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-72756391-56a6-4382-a2d2-510a4f895c5f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.158345 Aug 24 09:45:20.019854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 692/1379] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:19 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:21.040466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:21.041106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:21.053184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:21.053184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:21.053184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:21.053184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:21.053592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:21.053592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:21.180653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:21.189971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-55748666-6180-45c0-96ef-9215be0e711b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153537 Aug 24 09:45:21.190538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 688/1380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:21 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:22.210281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:22.210826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:22.217160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:22.217641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:22.218077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:22.218766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:22.219222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:22.219674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:22.348282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:22.356363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-34dfdf8c-6530-446a-89fd-d72e3f6d96e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150271 Aug 24 09:45:22.356924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 693/1381] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:22 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:23.376838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:23.377446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:23.383882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:23.384356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:23.384783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:23.385463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:23.385909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:23.386329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:23.518595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:23.526893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0d86d37f-50d6-42a0-9a70-95897fa37470 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153831 Aug 24 09:45:23.527462 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 689/1382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:23 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:24.548882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:24.549488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:24.555777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:24.556255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:24.556688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:24.557371 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:24.557817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:24.558321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:24.682627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:24.690685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-de596d8d-6175-49c3-b2a3-cfc86ff82ead tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146233 Aug 24 09:45:24.691243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 694/1383] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:24 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:25.711830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:25.712447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:25.718867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:25.719376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:25.719857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:25.720552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:25.721009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:25.721438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:25.855625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:25.864362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dd770c4b-84ee-4092-a152-217d9aa846a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156737 Aug 24 09:45:25.864923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 690/1384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:25 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:26.885441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:26.885994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:26.893149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:26.893632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:26.894065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:26.894753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:26.895234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:26.895687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:27.024771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:27.033186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f0c6dd31-5199-4aab-8e4e-fc2d354c252f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151819 Aug 24 09:45:27.033801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 695/1385] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:26 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:28.054260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:28.054872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:28.061358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:28.061834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:28.062264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:28.062945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:28.063946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:28.064368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:28.189608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:28.197668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a9c7205f-521c-42c7-9582-b5a506b4587b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147309 Aug 24 09:45:28.198233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 691/1386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:28 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:29.220106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:29.220722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:29.223113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=26 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:29.227920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:29.228406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:29.228847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:29.229588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:29.230043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:29.230470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:29.233164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=78 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:29.366778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:29.369631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3a9066c0-5a65-4b7c-8a9d-6a9746202b24 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154180 Aug 24 09:45:29.370187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 696/1387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:29 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:30.390623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:30.391306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:30.393423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=26 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:30.398089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:30.398570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:30.399011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:30.399736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:30.400194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:30.400624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:30.403144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=78 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:30.536068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:30.551811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cf190eb5-508d-465c-b5fe-556999c63f33 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.157485 Aug 24 09:45:30.551811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 692/1388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:30 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:31.565192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:31.565834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:31.572376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:31.572850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:31.573288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:31.574160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:31.574614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:31.575039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:31.813071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:31.821210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-728150b1-391a-47f5-8075-e01fd7880af1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.260619 Aug 24 09:45:31.821772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 697/1389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:31 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:32.842063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:32.842608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:32.849476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:32.849979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:32.850451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:32.851134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:32.851606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:32.852034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:32.981434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:32.989492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a689b088-fa1d-4920-a45f-eb019bba7579 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151476 Aug 24 09:45:32.990050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 693/1390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:32 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:34.009968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:34.010586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:34.017194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:34.017751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:34.018099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:34.018795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:34.019251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:34.019710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:34.153574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:34.156081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0214c597-a1f4-4be4-8b45-852f4d2b50cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149934 Aug 24 09:45:34.156663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 698/1391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:34 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:35.176686 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:35.177427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:35.183795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:35.184297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:35.184733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:35.185413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:35.185861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:35.186281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:35.316528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:35.324589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7796ef2f-5a7e-49f5-b3a4-a9d0a1032fb9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152393 Aug 24 09:45:35.325159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 694/1392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:35 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:36.346447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:36.347062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:36.353604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:36.354082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:36.354511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:36.355197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:36.355686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:36.356109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:36.481595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:36.489831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-18f90506-eee4-4360-9f68-bc25941c0387 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147753 Aug 24 09:45:36.490408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 699/1393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:36 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:37.510934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:37.511503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:37.518462 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:37.518947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:37.519389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:37.520141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:37.520601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:37.521031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:37.647425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:37.655515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e851983b-c95f-488d-9496-c3c72c07c893 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148514 Aug 24 09:45:37.656121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 695/1394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:37 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:38.677665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:38.678306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:38.684658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:38.685131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:38.685561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:38.686237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:38.686684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:38.687104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:38.816742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:38.824873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7f0395ec-ef88-46c6-b91a-5904e3f6253b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151057 Aug 24 09:45:38.825434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 700/1395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:38 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:39.846306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:39.846924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:39.853503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:39.853987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:39.854424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:39.855121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:39.855672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:39.856035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:39.989804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:39.999198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8dddadc0-32ce-4e5e-a3f4-5534a898e084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156773 Aug 24 09:45:39.999794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 696/1396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:39 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:41.020189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:41.040403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:41.040403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:41.040403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:41.040403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:41.041345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:41.041345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:41.041345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:41.160656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:41.169153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5e00a714-2a52-4af7-a2d5-171fb8383029 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152773 Aug 24 09:45:41.169657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 701/1397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:41 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:42.190214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:42.191174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:42.197640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:42.198117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:42.198550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:42.199237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:42.199720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:42.200141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:42.326394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:42.334705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-63fc4d28-3576-4ce1-b02a-24f2b2c5de38 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148590 Aug 24 09:45:42.335272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 697/1398] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:42 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:42.445321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:42.445833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:42.452206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:42.452688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:42.453141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:42.454400 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:42.454850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:42.455272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:42.480975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:45:42.809299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0686db4d-2e43-4947-8652-6349dd11d648 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 204 len: 0 microversion: 2.1 time: 0.367465 Aug 24 09:45:42.809871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 702/1399] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:45:42 2022] DELETE /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:45:42.818735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:42.824851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:42.825269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:42.825750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:42.826188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:42.826870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:42.827323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:42.827781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:42.955810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:42.963731 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ee8bb302-835a-4b42-8a41-ec83fa1347e1 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1673 microversion: 2.1 time: 0.148830 Aug 24 09:45:42.964297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 698/1400] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:42 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:43.356742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:43.357381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:43.363671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:43.364149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:43.364585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:43.365268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:43.365718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:43.366139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:43.498805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:43.507781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3d12b4be-b7ef-41fe-a714-b561e5f99f31 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155386 Aug 24 09:45:43.508353 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 703/1401] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:43 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:43.985232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:43.986081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:43.992813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:43.993294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:43.993726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:43.994415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:43.994862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:43.995284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:44.223771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:44.233044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2b2d7484-810b-4321-aea1-d642bc14e110 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1673 microversion: 2.1 time: 0.252227 Aug 24 09:45:44.233619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 699/1402] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:43 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1673 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:45:44.528764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:44.529374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:44.536326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:44.536800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:44.537233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:44.537916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:44.538369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:44.538788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:44.676462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:44.684707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-31cad5e7-8c85-4404-9992-0a1118f4ab1a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.159858 Aug 24 09:45:44.685283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 704/1403] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:44 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:44.857034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-9aa0fab7-dee1-44f9-819f-babdc05b813d req-95faa4f8-8dd3-498f-a5ad-8c6da374fb1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7384e8a-d236-4e15-9dbf-6caf3034ceee", "name": "network-vif-deleted", "tag": "1aa841b8-3b02-4af0-bda2-a161690e08a2"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:45:44.866406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9aa0fab7-dee1-44f9-819f-babdc05b813d req-95faa4f8-8dd3-498f-a5ad-8c6da374fb1a service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:44.866881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9aa0fab7-dee1-44f9-819f-babdc05b813d req-95faa4f8-8dd3-498f-a5ad-8c6da374fb1a service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:44.867306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-9aa0fab7-dee1-44f9-819f-babdc05b813d req-95faa4f8-8dd3-498f-a5ad-8c6da374fb1a service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:44.881038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-9aa0fab7-dee1-44f9-819f-babdc05b813d req-95faa4f8-8dd3-498f-a5ad-8c6da374fb1a service nova] Creating event network-vif-deleted:1aa841b8-3b02-4af0-bda2-a161690e08a2 for instance b7384e8a-d236-4e15-9dbf-6caf3034ceee on hv-cinder-85032 Aug 24 09:45:44.886456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-9aa0fab7-dee1-44f9-819f-babdc05b813d req-95faa4f8-8dd3-498f-a5ad-8c6da374fb1a service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033014 Aug 24 09:45:44.887407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 700/1404] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 09:45:45.254587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:45.255206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:45.277533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:45.277533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:45.277533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:45.277533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:45.278558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:45.278558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:45.306670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:45.307155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:45.308999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:45.308999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lazy-loading 'fault' on Instance uuid b7384e8a-d236-4e15-9dbf-6caf3034ceee {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:45:45.367059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9099dc3ad92431cbac98f144690038c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '803ce13612e0460682ef8b4d42781a99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:45.375296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-082d715f-6631-4dd7-a581-68a56df164cf tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 200 len: 1328 microversion: 2.1 time: 0.125041 Aug 24 09:45:45.376077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 705/1405] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:45 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 1328 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:45:45.707843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:45.708965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:45.715218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:45.715695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:45.716143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:45.716913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:45.717378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:45.717807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:45.862847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:45.871068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7be3bad5-283f-4147-9844-104f67881c61 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.168618 Aug 24 09:45:45.875524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 701/1406] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:45 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:46.396833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:46.397537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:46.403877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:46.404367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:46.404812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:46.405509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:46.405964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:46.406421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:46.420022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] HTTP exception thrown: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Request method failure captured: Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee HTTP/1.1 Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8pD5JntjOIDel1FeefqltliRCbc8jhDmwpoJ1AGKlrql1sjCNop2osA4DN5R4KVIwhGobez73bk65_QS0kIbmkcsDbH8aAGj1kd_YA8kK_j-0PdbnMb-Gl4ASuHbIUnzuFdEnJ-YfoQRPZD7dV4T_DgsVXyzpeBBYJTAg0vidot_8 Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:45:46.422254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803ce13612e0460682ef8b4d42781a99", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: b9099dc3ad92431cbac98f144690038c Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:45:46.424234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'b7384e8a-d236-4e15-9dbf-6caf3034ceee'} Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:45:46.425579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:45:46.427488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:45:46.429013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Returning 404 to user: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:45:46.429013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2b9f1257-70e5-498a-9be4-7f4ddafea3e6 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 404 len: 111 microversion: 2.1 time: 0.030766 Aug 24 09:45:46.429013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 706/1407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:46 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:45:46.432367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7012071b-a89e-4e7b-b1bd-e33c9683b1fc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '.version_select at 0x7fa912c77e50>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:46.501760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7012071b-a89e-4e7b-b1bd-e33c9683b1fc tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941069782" status: 202 len: 0 microversion: 2.1 time: 0.073026 Aug 24 09:45:46.502330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 702/1408] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Aug 24 09:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1941069782 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:45:46.893239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:46.893848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:46.899890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:46.900373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:46.900816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:46.901511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:46.901969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:46.902397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:47.032898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:47.041258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9d870259-eb89-46a1-b068-505654e35933 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152544 Aug 24 09:45:47.044328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 707/1409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:46 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:48.063050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:48.063691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:48.069587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:48.070067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:48.070507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:48.071196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:48.071684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:48.072114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:48.198519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:48.206651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-681a1318-8ff1-485a-86c4-05c6612677d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148601 Aug 24 09:45:48.207220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 703/1410] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:48 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:49.228170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:49.228790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:49.235239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:49.235798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:49.236240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:49.236929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:49.237380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:49.237803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:49.365739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:49.373852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-72160677-ef96-4076-83c0-8ff753662147 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149546 Aug 24 09:45:49.374407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 708/1411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:49 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:50.396259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:50.396923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:50.403347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:50.403851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:50.404288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:50.404974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:50.405424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:50.405847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:50.534796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:50.543024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4587a034-36be-43db-b4e8-7f9ac2c51dbb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150656 Aug 24 09:45:50.543888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 704/1412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:50 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:51.562989 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:51.563555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:51.570198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:51.570676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:51.571108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:51.571902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:51.572357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:51.572778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:51.703133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:51.712173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1ee9323c-aae2-4291-a7cf-ee6d1cb23f50 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153105 Aug 24 09:45:51.712734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 709/1413] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:51 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:52.732500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:52.733147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:52.740068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:52.740549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:52.740984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:52.741676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:52.742126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:52.742547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:52.871106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:52.879345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-03243155-937d-4ef6-b767-47b7680d70f4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150611 Aug 24 09:45:52.890039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 705/1414] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:52 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:53.899414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:53.900055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:53.906473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:53.906948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:53.907380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:53.908746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:53.909199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:53.909644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:54.041978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:54.050281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7b8f53b6-316d-4604-adf8-63329cee1365 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154632 Aug 24 09:45:54.054903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 710/1415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:53 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:55.070142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:55.070815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:55.077124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:55.077598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:55.078030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:55.078711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:55.079155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:55.079572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:55.208219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:55.217442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4e4cac7e-5887-4839-9fee-76946dbdcc73 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151086 Aug 24 09:45:55.218114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 706/1416] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:55 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:56.238199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:56.238750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:56.245080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:56.245561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:56.245999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:56.246689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:56.247145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:56.247574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:56.262289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:45:56.382241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:56.390172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a9fde76a-b38d-401f-a7ba-ca4463c596df tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155937 Aug 24 09:45:56.390731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 711/1417] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:56 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:57.410912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:57.411536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:57.417913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:57.418371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:57.418800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:57.419479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:57.419950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:57.422913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:57.549167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:57.557311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9f658c45-baf2-41b8-8bac-8708c3d307bd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150744 Aug 24 09:45:57.557821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 707/1418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:57 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:58.577881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:58.578502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:58.585167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:58.585650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:58.586086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:58.586781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:58.587238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:58.587697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:58.716401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:58.721099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-154cefed-7be0-41ab-b0a9-2170ee1536f8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146689 Aug 24 09:45:58.721660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 712/1419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:58 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:45:59.741305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:45:59.741975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:45:59.748045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:59.748528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:59.748990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:59.749681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:45:59.750141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:45:59.750568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:45:59.875358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:45:59.884058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0b1cb1c1-67f4-4fc3-8393-8bf9beab5b69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146566 Aug 24 09:45:59.884631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 708/1420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:45:59 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:00.905086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:00.905703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:00.907500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:00.912110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:00.912586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:00.913014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:00.913690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:00.914138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:00.914556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:01.044275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:01.053050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1b4182ed-3b7a-4b6d-8a5a-9e84a918d0a8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152014 Aug 24 09:46:01.053611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 713/1421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:00 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:02.077611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:02.078208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:02.081289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:02.086272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:02.086787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:02.087213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:02.087943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:02.088391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:02.088814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:02.091384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=92 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:02.222839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:02.231484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e3e2151-e3da-4a84-abac-6c02734771d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.161276 Aug 24 09:46:02.232011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 709/1422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:02 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:03.252658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:03.253275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:03.259551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:03.260063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:03.260499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:03.261187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:03.261641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:03.262066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:03.393678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:03.401932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7c265cf0-b523-4a00-8126-c474125a13dd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153567 Aug 24 09:46:03.402593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 714/1423] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:03 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:04.424745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:04.425354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:04.432407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:04.432923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:04.433333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:04.434105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:04.434564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:04.434991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:04.574425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:04.582477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c7ba756f-b2f4-4d5e-a18d-52fa5e1aeec0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.162268 Aug 24 09:46:04.583031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 710/1424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:04 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:05.602801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:05.603424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:05.609866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:05.610346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:05.610782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:05.611469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:05.612508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:05.612932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:05.738675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:05.747110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1d07e92e-a90e-4de4-b237-3e7ba1c3c066 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148059 Aug 24 09:46:05.747698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 715/1425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:05 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:06.767883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:06.768492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:06.775054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:06.775535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:06.776005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:06.776696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:06.777153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:06.777582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:06.909185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:06.917387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-76bb3484-15e8-4839-868e-e97fcbd4381d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153481 Aug 24 09:46:06.917951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 711/1426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:06 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:07.938543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:07.939150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:07.946237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:07.946717 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:07.947150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:07.947873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:07.948328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:07.948748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:08.081232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:08.089560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1424be60-5502-4521-8b32-9cd78da2e4c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155009 Aug 24 09:46:08.090124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 716/1427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:07 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:09.109366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:09.109983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:09.116552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:09.117028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:09.117457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:09.118143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:09.118597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:09.119016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:09.244820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:09.253354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-15c249b2-2520-4fe6-afd2-354cad6fddc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147914 Aug 24 09:46:09.253922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 712/1428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:09 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:10.274455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:10.275019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:10.281367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:10.281842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:10.282269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:10.282949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:10.283928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:10.284345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:10.411620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:10.419619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4ea973bf-2082-4deb-8c8d-edd6c022fbf5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149040 Aug 24 09:46:10.420180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 717/1429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:10 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:11.440710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:11.441327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:11.447630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:11.448110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:11.448543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:11.449224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:11.449699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:11.450118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:11.578509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:11.586856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a11aeecc-b04b-467c-bac6-8e6ad5e8b546 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150627 Aug 24 09:46:11.587421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 713/1430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:11 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:12.608144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:12.608701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:12.622290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:12.622770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:12.623208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:12.623941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:12.624398 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:12.624822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:12.768339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:12.779891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-42bcd7ee-f80d-427d-bae6-44ac54f8ffc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.175514 Aug 24 09:46:12.780605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 718/1431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:12 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:13.801772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:13.802407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:13.808768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:13.809249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:13.809687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:13.810375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:13.810856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:13.811278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:13.949749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:13.957994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b03e2e0a-3964-4c4d-be70-d32792dc02cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.160764 Aug 24 09:46:13.958565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 714/1432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:13 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:14.978707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:14.979336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:14.985713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:14.986199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:14.986639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:14.987363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:14.987890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:14.988468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:15.116470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:15.124516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f858f187-29ee-46fc-b970-40c49e0508ba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149747 Aug 24 09:46:15.125079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 719/1433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:14 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:16.150487 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:16.151072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:16.157692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:16.158178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:16.158615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:16.159305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:16.159793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:16.160218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:16.286345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:16.294423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9c9d75d9-fe8d-4529-9cd6-0933c1c77500 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147838 Aug 24 09:46:16.294988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 715/1434] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:16 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:17.315705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:17.316327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:17.322818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:17.326433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:17.326433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:17.326433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:17.326433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:17.326809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:17.454634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:17.463913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fdf5dc87-4005-4766-a76a-8e64d6af396b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152093 Aug 24 09:46:17.464474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 720/1435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:17 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:18.484651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:18.485185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:18.492153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:18.492626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:18.493054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:18.493731 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:18.494178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:18.494597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:18.624086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:18.632117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-681d777b-3e34-4e6b-b185-8958273d9772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151382 Aug 24 09:46:18.632683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 716/1436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:18 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:19.652759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:19.653327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:19.660375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:19.660854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:19.661289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:19.661978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:19.662430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:19.662852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:19.791075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:19.799216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25c746c1-0822-423a-8163-015a1fb89683 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150369 Aug 24 09:46:19.799816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 721/1437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:19 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:20.819955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:20.820561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:20.826881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:20.827356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:20.827828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:20.828509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:20.828952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:20.829368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:20.955613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:20.963925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-31c8a63e-d143-41ff-b431-265b7b160716 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147790 Aug 24 09:46:20.964488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 717/1438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:20 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:21.984718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:21.985342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:21.992472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:21.992894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:21.993330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:21.994022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:21.994468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:21.994889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:22.120211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:22.128951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6bac2a8d-d774-4d03-b2a3-b022bd0aedc9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148166 Aug 24 09:46:22.129516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 722/1439] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:21 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:46:23.149969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:23.150556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:23.156891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:23.157366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:23.157802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:23.158469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:23.159483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:23.159927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:23.288275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:23.296355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aaeb9bee-0b68-4e1c-ba01-74082d65647e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150182 Aug 24 09:46:23.296929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 718/1440] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:23 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:24.317995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:24.318618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:24.325071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:24.325557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:24.326000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:24.326700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:24.327158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:24.327604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:24.469755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:24.477849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-52a3e421-032e-4061-9f5b-0f2702657926 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.164524 Aug 24 09:46:24.478415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 723/1441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:24 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:25.497842 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:25.498506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:25.504847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:25.505325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:25.505733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:25.506421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:25.506865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:25.507284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:25.635378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:25.643463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-91f3003c-7a98-4f50-9671-363ebe53c419 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149540 Aug 24 09:46:25.644608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 719/1442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:25 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:26.665201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:26.665812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:26.672287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:26.672773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:26.673308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:26.674011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:26.674494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:26.675594 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:26.679633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=76 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:26.801067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:26.809215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0555edb5-033e-44f3-8be6-95a9bf66666f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147793 Aug 24 09:46:26.809847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 724/1443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:26 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:27.830165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:27.830720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:27.837886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:27.838365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:27.838799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:27.839481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:27.839951 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:27.840367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:27.972313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:27.980361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58df9e81-206f-48bc-b134-521d9488470b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154099 Aug 24 09:46:27.980922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 720/1444] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:27 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:28.484439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:46:28.484680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:46:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:46:29.000976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:29.001530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:29.007962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:29.008438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:29.008872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:29.009558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:29.010011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:29.010438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:29.137598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:29.146196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e8a4e835-9d6b-4609-89a3-2a51ca0165e3 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149199 Aug 24 09:46:29.146757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 725/1445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:28 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:30.167651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:30.168282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:30.174221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:30.174694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:30.175124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:30.175840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:30.176286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:30.176707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:30.306690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:30.314938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-477c600f-533b-464c-816a-2fe54eed071a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151260 Aug 24 09:46:30.315495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 721/1446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:30 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:31.337128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:31.337745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:31.339755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=26 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:31.344358 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:31.344832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:31.345260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:31.345935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:31.346378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:31.346802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:31.471511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:31.479721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2016e06c-46b0-43a2-af80-7e5ebf5be302 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146716 Aug 24 09:46:31.480293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 726/1447] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:31 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:32.500769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:32.501390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:32.508554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:32.509038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:32.509480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:32.510174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:32.510631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:32.511067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:32.514955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=78 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:32.637945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:32.646750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dc050bc0-68ad-4eb0-9c2f-3a9b1789a875 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149261 Aug 24 09:46:32.647311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 722/1448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:32 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:33.667666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:33.668200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:33.674533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:33.675005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:33.675435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:33.676140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:33.676590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:33.677531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:33.801518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:33.810101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0c417891-8bc0-4c25-b519-273fcd7cba0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146374 Aug 24 09:46:33.810661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 727/1449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:33 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:34.831337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:34.831994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:34.835116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:34.839940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:34.840425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:34.840868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:34.841559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:34.842015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:34.842443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:34.980119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:34.987950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4f1cec7e-0890-42cb-9c61-e1dc5fb35828 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.160259 Aug 24 09:46:34.988523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 723/1450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:34 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:36.009744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:36.010377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:36.017687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:36.017687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:36.017687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:36.017971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:36.018421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:36.018839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:36.152666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:36.160815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ad6dfed3-11eb-486e-b2c6-62d660a84588 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155445 Aug 24 09:46:36.161858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 728/1451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:36 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:37.181716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:37.182339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:37.188736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:37.189225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:37.189662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:37.190358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:37.190814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:37.191244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:37.319361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:37.327512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dd47ccf0-9c86-4171-9745-ea5213c4d9c6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149638 Aug 24 09:46:37.328179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 724/1452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:37 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:38.349277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:38.349923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:38.356300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:38.356782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:38.357218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:38.357908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:38.358360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:38.358787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:38.488337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:38.496990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2e0fd1b4-811b-48da-af4a-10129b8a7111 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152110 Aug 24 09:46:38.497544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 729/1453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:38 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:39.517788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:39.518371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:39.524761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:39.525234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:39.525664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:39.526340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:39.526791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:39.527207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:39.655907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:39.664504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2b5fdb57-9f40-45d0-830d-8dbb89ac07d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150728 Aug 24 09:46:39.665055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 725/1454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:39 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:40.685184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:40.685817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:40.692945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:40.693446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:40.693881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:40.694573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:40.695025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:40.695448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:40.825229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:40.833344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9c9fd008-1c2f-4634-a863-c1996032bd2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152053 Aug 24 09:46:40.833903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 730/1455] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:40 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:41.854767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:41.855373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:41.861678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:41.862150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:41.862586 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:41.863265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:41.863741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:41.864682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:41.991144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:41.999205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0dbbc1d2-e9d3-486e-8a52-57aa76b7bc66 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148247 Aug 24 09:46:41.999853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 726/1456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:41 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:43.019894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:43.021075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:43.027507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:43.028019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:43.028454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:43.029139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:43.029591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:43.030029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:43.155611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:43.163791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ab905f52-334d-4a7c-8924-87be6ca4356d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147743 Aug 24 09:46:43.164356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 731/1457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:43 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:44.184770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:44.188564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:44.191925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:44.192416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:44.192847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:44.193545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:44.193973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:44.194388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:44.318637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:44.326643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b86111a2-4084-4b95-bbef-e84005fd2603 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.145709 Aug 24 09:46:44.327196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 727/1458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:44 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:45.348185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:45.351701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:45.355714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:45.356193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:45.356630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:45.357389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:45.357818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:45.358246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:45.485876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:45.494533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-65620a0b-6683-4c42-bf85-9b64bb6f4df5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150187 Aug 24 09:46:45.495370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 732/1459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:45 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:46.528825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:46.529440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:46.535721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:46.536199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:46.536638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:46.537319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:46.538370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:46.538985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:46.672768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:46.681328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ea708f95-6258-4d2a-9a02-2883dac8797b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156295 Aug 24 09:46:46.681975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 728/1460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:46 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:47.701995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:47.702750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:47.709312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:47.710303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:47.710739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:47.711434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:47.711915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:47.712345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:47.840815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:47.848978 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-61bf6976-1ad3-4eeb-b327-c224b72f2ef0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150814 Aug 24 09:46:47.849542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 733/1461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:47 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:48.870167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:48.870771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:48.877207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:48.877620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:48.878049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:48.878728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:48.879173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:48.879669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:49.004099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:49.012755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c028171b-b67e-43cc-83b2-22afab298709 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146531 Aug 24 09:46:49.013315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 729/1462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:48 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:50.033456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:50.034078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:50.041208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:50.041693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:50.042134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:50.042822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:50.043280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:50.043741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:50.168356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:50.176446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-75208b08-f257-4fc6-8f5d-6d54f67a4dff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146822 Aug 24 09:46:50.177006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 734/1463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:50 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:51.197623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:51.198242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:51.204786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:51.205268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:51.205704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:51.206400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:51.206853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:51.207279 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:51.574720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:51.582673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fd9e44c9-59e3-4449-a344-4b18e95fe193 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.388945 Aug 24 09:46:51.583233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 730/1464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:51 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:52.603825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:52.604438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:52.610839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:52.611346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:52.611818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:52.612512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:52.612963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:52.613389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:52.742965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:52.751128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-63c19f63-cc33-43bf-b64e-32cbb6cb2211 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151448 Aug 24 09:46:52.751723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 735/1465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:52 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:53.773283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:53.773897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:53.780282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:53.780762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:53.781198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:53.781887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:53.782342 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:53.782768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:53.908619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:53.917375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-99074d01-6054-4fd1-905a-782e24b9a661 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148555 Aug 24 09:46:53.917934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 731/1466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:53 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:46:54.938458 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:54.939077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:54.946096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:54.946578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:54.947015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:54.947784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:54.948242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:54.948674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:55.082100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:55.090807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-10f2ff0a-5b90-4875-8d1b-1f6410736d17 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156459 Aug 24 09:46:55.094564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 736/1467] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:54 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:56.112110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:56.112722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:56.119073 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:56.119554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:56.120024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:56.120717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:56.121168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:56.121595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:56.248497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:56.256605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4279df8a-3112-45b5-8c56-7f16128bdd0a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148247 Aug 24 09:46:56.257112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 732/1468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:56 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:57.277960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:57.278597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:57.284932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:57.285402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:57.285836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:57.286514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:57.286959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:57.287402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:57.291242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=78 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:46:57.418824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:57.427030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ddada13f-923b-4363-bfcd-d50c1f897bbf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152912 Aug 24 09:46:57.427607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 737/1469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:57 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:58.182658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:58.183190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:58.189632 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:58.190050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:58.190479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:58.191165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:58.191635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:58.192057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:58.221403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:46:58.448758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:58.449927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:58.456816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:58.457293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:58.457729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:58.458862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:58.460229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:58.460761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:58.493422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8630ac6a-7ffa-4a8e-b915-84b3880b23ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 204 len: 0 microversion: 2.1 time: 0.314202 Aug 24 09:46:58.494116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 733/1470] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:46:58 2022] DELETE /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:46:58.503204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:58.504068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:58.510664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:58.511129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:58.511743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:58.512434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:58.512908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:58.513332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:58.615328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:58.623572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-58a10d75-4e16-4515-9e1e-d99c54b473c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.178685 Aug 24 09:46:58.624165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 738/1471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:58 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:58.646195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:58.655041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7e8161a7-cf6d-4bec-934b-a1a67dbfd912 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.156372 Aug 24 09:46:58.655618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 734/1472] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:46:59.644675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:59.645315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:59.651759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:59.652237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:59.652680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:59.653364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:59.653816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:59.654241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:59.676353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:46:59.676966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:46:59.683996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:59.684469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:59.684940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:59.685625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:46:59.686215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:46:59.686645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:46:59.783733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:59.793034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7d13ca8b-37d7-424f-a216-78e2b63cf03c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152249 Aug 24 09:46:59.793609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 739/1473] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:59 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:46:59.821534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:46:59.830926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fc8da1fb-2ba7-4aca-acc9-4bdb2a643495 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.158531 Aug 24 09:46:59.831479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 735/1474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:46:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:00.814413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:00.814962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:00.821836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:00.822320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:00.822787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:00.823484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:00.823968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:00.824397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:00.851868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:00.852502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:00.858759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:00.859236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:00.859695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:00.860379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:00.860824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:00.861246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:00.954628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:00.963729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ded1632f-4349-47b0-b5a4-50d9fd49b4fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153170 Aug 24 09:47:00.964391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 740/1475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:00 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:00.990666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:00.998775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a7a12798-2ea0-4f6a-9050-601e0d0e1d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.150672 Aug 24 09:47:00.999335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 736/1476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:01.984744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:01.985299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:01.987653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=30 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:01.993002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:01.993484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:01.993917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:01.994610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:01.995056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:01.995475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:02.019560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:02.020306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:02.026736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:02.027222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:02.027683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:02.028382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:02.028836 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:02.029262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:02.033434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:02.126704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:02.135449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-22bc7d9c-7aee-4b22-9c99-0833cb81b1d4 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154644 Aug 24 09:47:02.136037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 741/1477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:01 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:02.156503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:02.164464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-73d9200f-1ead-4dd1-9da1-2f6280ea6b77 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.148750 Aug 24 09:47:02.165047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 737/1478] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:03.156443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:03.157054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:03.164023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:03.164518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:03.164951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:03.165638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:03.166090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:03.166514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:03.185539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:03.186164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:03.192431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:03.192917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:03.193363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:03.194059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:03.194516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:03.194945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:03.301998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:03.316589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a5499e40-2a34-456e-8569-eb3dd02114e2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.163691 Aug 24 09:47:03.317446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 742/1479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:03 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:03.326949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:03.335386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bac28573-e871-4526-b1a2-d7ae3ec48ada tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.153751 Aug 24 09:47:03.336006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 738/1480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:04.342531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:04.343140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:04.349533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:04.350016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:04.350450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:04.351144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:04.351606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:04.352044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:04.356654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:04.357297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:04.363885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:04.364365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:04.364801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:04.365519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:04.365984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:04.366406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:04.484832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:04.494298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fc1747f8-5d2a-4b43-9e7a-42683d530703 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155543 Aug 24 09:47:04.495388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 743/1481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:04 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:04.503627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:04.515906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3ae3980b-ed40-4ccc-948a-c98b01578dbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.162914 Aug 24 09:47:04.516474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 739/1482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:05.515571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:05.516204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:05.522813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:05.523324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:05.523816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:05.524543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:05.525001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:05.525434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:05.536671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:05.537328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:05.540180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:05.544896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:05.545595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:05.546029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:05.546724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:05.547171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:05.547611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:05.661746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:05.670345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e0f98475-ee29-4fb3-9f71-8dc7fee822b2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.158593 Aug 24 09:47:05.671205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 744/1483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:05 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:05.688774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:05.696870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9113bd8f-6edb-479e-8f87-134902c62f6d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.163939 Aug 24 09:47:05.697426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 740/1484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:06.691177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:06.691830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:06.698108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:06.698581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:06.699009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:06.699716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:06.700165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:06.700614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:06.717711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:06.718330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:06.724637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:06.725126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:06.725564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:06.726932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:06.727387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:06.727839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:06.832144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:06.842013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-446710a6-1428-430b-b7a3-243aecfa0905 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154550 Aug 24 09:47:06.842803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 745/1485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:06 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:06.863793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:06.874213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9c2b608b-e870-4b5f-94f3-b4f2645149db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.160259 Aug 24 09:47:06.874981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 741/1486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:07.863148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:07.863790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:07.870274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:07.870751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:07.871190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:07.871912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:07.872368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:07.872791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:07.896255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:07.897022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:07.904990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:07.905489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:07.905924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:07.906623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:07.907082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:07.907504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:08.017979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:08.026241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6872d7d1-3072-452e-a8bc-97107b7b3336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.166987 Aug 24 09:47:08.026871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 746/1487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:07 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:08.051333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:08.060124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7ac5aedf-b970-44bd-859e-66b94969f9ac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.167703 Aug 24 09:47:08.060692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 742/1488] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:08.740328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:08.747698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:08.747698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:08.747698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:08.748044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:08.748588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:08.749041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:08.749468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:08.774961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:47:09.035431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-922fd299-e45e-4982-8d00-6e4cce8a03b5 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 204 len: 0 microversion: 2.20 time: 0.298574 Aug 24 09:47:09.036092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 747/1489] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Aug 24 09:47:08 2022] DELETE /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:47:09.046889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:09.047457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:09.047595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:09.048236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:09.054278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:09.054492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:09.054774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:09.054894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:09.055217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:09.055348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:09.055952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:09.056074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:09.056410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:09.056544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:09.056919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:09.057045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:09.190259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:09.190563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:09.199105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9f89e776-325a-4b5a-8c1a-f3e18d6a0390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155680 Aug 24 09:47:09.199269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:09.199597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 748/1490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:09 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:09.200763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:09.202149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8b5bff25-b06e-4566-94b7-d0b191db57da tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1723 microversion: 2.20 time: 0.159228 Aug 24 09:47:09.202876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 743/1491] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:47:09 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:47:09.204175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:09.204785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:09.211484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:09.212119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:09.212532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:09.213215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:09.213661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:09.214081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:09.342025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:09.350064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d6fceb63-f116-4121-a6e9-8ddf925df5ca tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.149528 Aug 24 09:47:09.350624 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 749/1492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:10.220614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:10.221279 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:10.226073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:10.226836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:10.227733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:10.228219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:10.228650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:10.229337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:10.229876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:10.230211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:10.233074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:10.233557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:10.234000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:10.234707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:10.235217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:10.235748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:10.369183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:10.377475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:10.378982 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:10.380384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ece5831d-7b59-414a-adc5-628aaf196cfd tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1723 microversion: 2.20 time: 0.158075 Aug 24 09:47:10.380942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 750/1493] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:47:10 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:47:10.400168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:10.400785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:10.406533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:10.407021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:10.407466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:10.408182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:10.408641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:10.409068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:10.456221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:10.459888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b7f228cf-ece6-489e-8470-dc02fb5577fa tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.243007 Aug 24 09:47:10.460657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 744/1494] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:10 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:10.537858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:10.546583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b88f5dea-65b4-4c32-9160-843bcca1b224 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.149965 Aug 24 09:47:10.547117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 751/1495] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:10.965816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-3cef7b88-2da5-4463-925a-5ace63612b69 req-5b6a9cf5-d510-4523-bde5-88fc8699e1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7305802-e1e6-46dc-a090-0748e35d748b", "name": "network-vif-deleted", "tag": "ec839274-e8bb-48c3-bcdc-cc5833943b51"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:47:10.976459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3cef7b88-2da5-4463-925a-5ace63612b69 req-5b6a9cf5-d510-4523-bde5-88fc8699e1fc service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:10.977042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3cef7b88-2da5-4463-925a-5ace63612b69 req-5b6a9cf5-d510-4523-bde5-88fc8699e1fc service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:10.977771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3cef7b88-2da5-4463-925a-5ace63612b69 req-5b6a9cf5-d510-4523-bde5-88fc8699e1fc service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:10.990144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-3cef7b88-2da5-4463-925a-5ace63612b69 req-5b6a9cf5-d510-4523-bde5-88fc8699e1fc service nova] Creating event network-vif-deleted:ec839274-e8bb-48c3-bcdc-cc5833943b51 for instance f7305802-e1e6-46dc-a090-0748e35d748b on hv-cinder-85032 Aug 24 09:47:10.995678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-3cef7b88-2da5-4463-925a-5ace63612b69 req-5b6a9cf5-d510-4523-bde5-88fc8699e1fc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104699 Aug 24 09:47:10.996855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 745/1496] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:47:11.404059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:11.404706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:11.411301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:11.411824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:11.412269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:11.412968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:11.413937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:11.414367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:11.418561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:11.445972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:11.446740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:11.446890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:11.447335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lazy-loading 'fault' on Instance uuid f7305802-e1e6-46dc-a090-0748e35d748b {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:47:11.481568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:11.482267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:11.489719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:11.489959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:11.490411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:11.491035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:11.492724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:11.493350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:11.493946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:11.500935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:11.502888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:11.504126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-77013df3-e9d9-417c-a8fe-c0c850d56b9a tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1371 microversion: 2.20 time: 0.104013 Aug 24 09:47:11.507397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 752/1497] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:47:11 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:47:11.568974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:11.569664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:11.587366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:11.591569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:11.591569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:11.591569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:11.591569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:11.592211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:11.661716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:11.671896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1688a14a-bb7d-43fe-b106-244387db6dac tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.194298 Aug 24 09:47:11.672472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 746/1498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:11 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:11.736788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:11.746831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0900e7d6-4317-4b19-a92c-9bb0edbaeab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.182493 Aug 24 09:47:11.747761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 753/1499] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:12.527253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:12.527946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:12.534834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:12.535321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:12.535804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:12.536507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:12.536966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:12.537399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:12.568897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:12.569391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:12.570489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:12.571272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lazy-loading 'fault' on Instance uuid f7305802-e1e6-46dc-a090-0748e35d748b {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:47:12.615190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:12.623987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:12.625534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'cbcaa84bc9c54d7aa4178d0174a5936e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd00ce4a2669e43dcb5bc8a2d77b11c2f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:12.626685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7bfd28af-cf7a-4d7d-a582-9bce7c76e131 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 200 len: 1371 microversion: 2.20 time: 0.103763 Aug 24 09:47:12.627245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 747/1500] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:47:12 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 24 09:47:12.692550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:12.693161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:12.700147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:12.700627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:12.701085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:12.701773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:12.702219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:12.702669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:12.768782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:12.769382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:12.775276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:12.775800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:12.776249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:12.776967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:12.777424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:12.777854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:12.833336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:12.841998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2e06f20a-b9f0-4b59-ba70-bb6e31e136d0 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153533 Aug 24 09:47:12.842942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 754/1501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:12 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:12.907133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:12.915964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f5794f7d-a032-4074-bd03-a6f9095dfb6b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.151185 Aug 24 09:47:12.916568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 748/1502] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:13.655568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:13.656196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:13.662216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:13.662692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:13.663124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:13.663838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:13.664287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:13.664708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:13.677552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] HTTP exception thrown: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Request method failure captured: Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b HTTP/1.1 Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8mM3Ug07VOcptQ0Yj1o3-Tz1EgPakdk8vikxbKE6MDN6hZ7lrvV8xnDHazAir6NUuwBhkpnJaB_KLKmGNKcD-WWlqyjsvAPwMZ6XhdCCsfobvlPzWpgFPs3o1Bc22ChZSy4-J_sGL7HYOXBFcB2HOjVU_roXNwZ6nAcY91-qUMa9o Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:47:13.679170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00ce4a2669e43dcb5bc8a2d77b11c2f", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: cbcaa84bc9c54d7aa4178d0174a5936e Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:47:13.681098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'f7305802-e1e6-46dc-a090-0748e35d748b'} Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:47:13.682342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:47:13.684034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:47:13.685686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Returning 404 to user: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:47:13.685686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b55b71f4-31d6-48f0-a97f-f092ed7e78bf tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 404 len: 111 microversion: 2.20 time: 0.028994 Aug 24 09:47:13.685686 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 755/1503] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:47:13 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:47:13.689188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b285e32f-e01e-4161-a3ee-b4f9fa914b2c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '.version_select at 0x7fa91b715700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:13.794649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b285e32f-e01e-4161-a3ee-b4f9fa914b2c tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734587211" status: 204 len: 0 microversion: 2.20 time: 0.109090 Aug 24 09:47:13.795237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 749/1504] 10.222.0.16 () {60 vars in 1262 bytes} [Wed Aug 24 09:47:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1734587211 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 24 09:47:13.863939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:13.864563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:13.871876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:13.872363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:13.872802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:13.873534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:13.873988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:13.874415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:13.937631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:13.938246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:13.944459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:13.944943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:13.946036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:13.946733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:13.947190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:13.947668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:14.054766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:14.062941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4c7c0244-3a10-4809-a371-9f6756d8b990 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.202852 Aug 24 09:47:14.064073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 756/1505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:13 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:14.209199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:14.218218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f7645d1b-e5f5-4eac-a99c-f78c9425fdc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.284826 Aug 24 09:47:14.218890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 750/1506] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:15.085065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:15.085682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:15.092666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:15.093143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:15.093693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:15.094387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:15.094835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:15.095255 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:15.222776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:15.230896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2172fbdb-ee01-4723-8657-241aa09535ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150597 Aug 24 09:47:15.231449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 757/1507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:15 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:15.239817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:15.240434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:15.246847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:15.247330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:15.247806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:15.248501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:15.248960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:15.249385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:15.382314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:15.390944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-abf8b92b-421b-46b3-87e2-9184e0aae33f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.155022 Aug 24 09:47:15.391504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 751/1508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:16.251470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:16.252110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:16.259234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:16.259747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:16.260187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:16.260878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:16.261330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:16.261757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:16.390470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:16.399080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-96d3f7e7-0194-4f5a-9323-a6b1b1d5e5c5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151415 Aug 24 09:47:16.399664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 758/1509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:16 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:16.411863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:16.412693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:16.419098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:16.419561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:16.420042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:16.420742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:16.421203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:16.421628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:16.550312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:16.559094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e366bd66-03e8-4415-a43b-caf355410768 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.151225 Aug 24 09:47:16.559691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 752/1510] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:17.419228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:17.420023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:17.425986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:17.426921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:17.427363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:17.428131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:17.428553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:17.428975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:17.561121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:17.569337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b6e6a3fe-8e81-4260-8a21-b863f8c0d7da tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153898 Aug 24 09:47:17.569900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 759/1511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:17 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:17.579494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:17.580139 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:17.587601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:17.588097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:17.588531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:17.589222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:17.589676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:17.590100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:17.717384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:17.725544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9de1eab9-f9a0-46f4-821e-1c3f1db5228e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.150140 Aug 24 09:47:17.726105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 753/1512] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:18.591088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:18.591656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:18.598004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:18.598488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:18.598921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:18.599645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:18.600092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:18.600512 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:18.725610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:18.734574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-72c29f8a-a6a0-43f8-b0f2-6458964f97a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147375 Aug 24 09:47:18.735194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 760/1513] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:18 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:18.746349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:18.747993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:18.754420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:18.754906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:18.755339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:18.756066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:18.756520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:18.756947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:18.889603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:18.897829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eeec5d6c-7111-4ea5-880a-db3868162b20 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.155361 Aug 24 09:47:18.899023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 754/1514] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:19.754602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:19.755236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:19.761698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:19.762181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:19.762620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:19.763309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:19.763843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:19.764216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:19.891571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:19.900257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-272a5ff8-5100-4cee-836c-eae996aef271 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149525 Aug 24 09:47:19.900816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 761/1515] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:19 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:19.919439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:19.920170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:19.927037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:19.927521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:19.927986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:19.928680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:19.929134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:19.929561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:19.933621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:20.058878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:20.066982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7f24f7e4-478c-4dec-9b66-7ab2281bf71f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.151314 Aug 24 09:47:20.067534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 755/1516] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:20.920953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:20.921516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:20.927900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:20.928381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:20.928817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:20.930004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:20.930456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:20.930884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:21.057132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:21.065289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-106fd0b5-1760-4f7a-b4f0-c1ed87f52460 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148346 Aug 24 09:47:21.065859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 762/1517] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:20 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:21.088513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:21.089189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:21.095660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:21.096146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:21.096586 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:21.097485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:21.097738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:21.098169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:21.229774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:21.238305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-10e51e1f-a7e9-4520-b111-c32f86370255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.154590 Aug 24 09:47:21.238882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 756/1518] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:22.087359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:22.088019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:22.094471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:22.094947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:22.095382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:22.096097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:22.096551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:22.096972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:22.221890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:22.229930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2dfaa031-4b26-470d-aa8a-a40801a1f6cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147427 Aug 24 09:47:22.230540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 763/1519] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:22 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:22.258663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:22.259273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:22.265628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:22.266108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:22.266547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:22.267232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:22.267717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:22.268145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:22.395717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:22.403792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2b3b4d18-dd66-40b2-ba87-98f40a59a0e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.149470 Aug 24 09:47:22.404348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 757/1520] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:23.250977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:23.251641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:23.258477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:23.258954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:23.259384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:23.260090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:23.260537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:23.260958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:23.390753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:23.398837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dc9e48b9-d4b0-4e71-a400-8c39abf1c299 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151569 Aug 24 09:47:23.399343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 764/1521] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:23 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:23.424297 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:23.424914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:23.432048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:23.432531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:23.432975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:23.433667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:23.434125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:23.434556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:23.568700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:23.576996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fee89863-e7a1-4553-91e2-15c9505ddb32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.156504 Aug 24 09:47:23.577554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 758/1522] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:24.420459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:24.421064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:24.427477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:24.427986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:24.428418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:24.429100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:24.429571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:24.429990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:24.554907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:24.563284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a8554cb0-2645-4216-afdb-9bf8cbecf87c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146606 Aug 24 09:47:24.572985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 765/1523] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:24 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:24.597419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:24.601848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:24.605201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:24.605689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:24.606124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:24.606812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:24.607268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:24.607738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:24.733349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:24.741343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7538ba51-8535-4871-8e97-80893b679842 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.147758 Aug 24 09:47:24.742023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 759/1524] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:25.591511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:25.592174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:25.598431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:25.598914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:25.599350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:25.600068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:25.600525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:25.601560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:25.730052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:25.738171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7536c4fd-11ce-48fa-b9f7-0c53643a267c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150438 Aug 24 09:47:25.738741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 766/1525] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:25 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:25.767268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:25.767900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:25.774184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:25.774657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:25.775088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:25.775796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:25.776242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:25.776658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:25.906932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:25.915679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3239f763-9f07-4939-b894-236d2b17fb7a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.152142 Aug 24 09:47:25.916248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 760/1526] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:26.759341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:26.759987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:26.766344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:26.766828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:26.767265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:26.767986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:26.768441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:26.768923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:26.906638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:26.915320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b501e9c9-63bf-4071-8ad1-a1885f2ef874 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.159807 Aug 24 09:47:26.915912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 767/1527] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:26 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:26.937066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:26.937796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:26.944222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:26.944795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:26.945735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:26.946416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:26.946895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:26.947526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:27.081518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:27.090031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f0db469e-caf3-4f0e-b870-74d999dee308 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.156846 Aug 24 09:47:27.090606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 761/1528] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:27.937947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:27.938561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:27.945368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:27.945843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:27.946316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:27.946988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:27.947437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:27.947882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:28.081054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:28.090272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-09075037-d53c-4b87-a310-e70d07627d23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156120 Aug 24 09:47:28.090846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 768/1529] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:27 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:28.111535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:28.112171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:28.118995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:28.119446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:28.119912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:28.120591 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:28.121039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:28.121459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:28.246838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:28.254856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-08bc2c59-5613-4c62-af3c-7c49efca1f1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.147169 Aug 24 09:47:28.255411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 762/1530] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:29.110210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:29.110853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:29.117885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:29.118369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:29.118811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:29.119516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:29.120004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:29.120435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:29.124380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:29.243504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:29.251570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ffa97582-7948-452e-b095-754831f5d8fc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.145274 Aug 24 09:47:29.252157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 769/1531] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:29 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:29.276467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:29.277076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:29.282891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:29.283361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:29.283829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:29.284507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:29.284952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:29.285370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:29.416264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:29.423013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6dcceaec-70b0-4f33-b27d-28a5d0045a2c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.150546 Aug 24 09:47:29.423566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 763/1532] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:30.272990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:30.274128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:30.280194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:30.280678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:30.281117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:30.281899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:30.282264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:30.282695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:30.409519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:30.417936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-20ba72ed-af3d-48e9-b868-b277769361d9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148840 Aug 24 09:47:30.418356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 770/1533] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:30 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:30.445875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:30.446787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:30.453833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:30.454305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:30.454736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:30.455414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:30.455891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:30.456312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:30.585652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:30.593741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1a96f7df-460f-4f3b-b42c-4279cd8a2392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1728 microversion: 2.1 time: 0.153156 Aug 24 09:47:30.594298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 764/1534] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:31.438337 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:31.438950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:31.446147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:31.446634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:31.451190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:31.451190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:31.451190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:31.451190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:31.600073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:31.612835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cef2ec20-eac5-4cf1-80be-10b41fe2cbbe tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.178265 Aug 24 09:47:31.613448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 771/1535] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:31 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:31.619718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:31.619718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:31.622703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:31.623248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:31.624002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:31.624801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:31.625478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:31.625995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:31.695492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:31.703476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ab5e4769-37a9-4196-8808-c9ec893cb629 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1661 microversion: 2.1 time: 0.093087 Aug 24 09:47:31.704068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 765/1536] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1661 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:32.139142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-3bcf8642-281c-4901-850e-02d73a8d1920 req-1af458bb-96ef-46d9-8273-f1dba1847cc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb650451-50be-4714-b442-2a6cbcf96d6d", "name": "network-vif-deleted", "tag": "b99cb60a-57da-4793-a9df-1b6184d7afdb"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:47:32.145173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:32.150506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-3bcf8642-281c-4901-850e-02d73a8d1920 req-1af458bb-96ef-46d9-8273-f1dba1847cc6 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:32.150988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-3bcf8642-281c-4901-850e-02d73a8d1920 req-1af458bb-96ef-46d9-8273-f1dba1847cc6 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:32.151421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-3bcf8642-281c-4901-850e-02d73a8d1920 req-1af458bb-96ef-46d9-8273-f1dba1847cc6 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:32.169260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-3bcf8642-281c-4901-850e-02d73a8d1920 req-1af458bb-96ef-46d9-8273-f1dba1847cc6 service nova] Creating event network-vif-deleted:b99cb60a-57da-4793-a9df-1b6184d7afdb for instance eb650451-50be-4714-b442-2a6cbcf96d6d on hv-cinder-85032 Aug 24 09:47:32.184460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-3bcf8642-281c-4901-850e-02d73a8d1920 req-1af458bb-96ef-46d9-8273-f1dba1847cc6 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039352 Aug 24 09:47:32.184460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 772/1537] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:47:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:47:32.634735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:32.635310 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:32.642367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:32.642859 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:32.643298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:32.644033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:32.644489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:32.644917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:32.728326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:32.729003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:32.736784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:32.737912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:32.743831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:32.743831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:32.743831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:32.743831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:32.783995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:32.793652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-05b025f6-b14d-493f-9afe-1abd782f474e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.162922 Aug 24 09:47:32.794236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 766/1538] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:32 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:32.812838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:32.821753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9614b96b-42df-49ec-9d94-e540bddeb040 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.100497 Aug 24 09:47:32.823961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 773/1539] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:33.815238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:33.815880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:33.822419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:33.822895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:33.823329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:33.824049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:33.824504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:33.824934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:33.842181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:33.842787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:33.849106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:33.849583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:33.850013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:33.850698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:33.851684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:33.852106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:33.912629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:33.921459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-875b0259-4e4e-4384-b0dc-ba99012dcf07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083004 Aug 24 09:47:33.922019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 774/1540] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:33.955814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:33.964519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b52d9572-b0fb-429b-aa32-c887bd7cb1cb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153123 Aug 24 09:47:33.965098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 767/1541] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:33 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:34.942454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:34.943076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:34.950211 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:34.950698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:34.951141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:34.951863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:34.952321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:34.952753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:34.986230 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:34.986922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:34.994151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:34.994670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:34.995107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:34.995858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:34.996308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:34.996728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:35.017446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:35.025643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f78e8832-78e7-45f5-83fb-2bda1bfd8b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087194 Aug 24 09:47:35.026408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 775/1542] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:35.121435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:35.129543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8f031d2d-c3e3-422a-9646-b0135d791823 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147202 Aug 24 09:47:35.130105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 768/1543] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:34 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:36.045934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:36.046552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:36.052891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:36.053374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:36.053812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:36.055075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:36.055529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:36.055983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:36.115668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:36.124230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7f5f38c7-5cc6-4be3-80b9-71295f938840 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082178 Aug 24 09:47:36.124791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 776/1544] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:36.150162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:36.150785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:36.153087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=61,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:36.157697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:36.158178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:36.158617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:36.159305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:36.159799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:36.160227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:36.288990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:36.297033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e9e863ad-9a0c-4389-a6d9-3cc50f523272 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150641 Aug 24 09:47:36.297603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 769/1545] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:36 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:37.145578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:37.146202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:37.152576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:37.153059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:37.153498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:37.154193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:37.154650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:37.155076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:37.221795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:37.230033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2c1e78cc-b498-4279-992b-74d740c5fe48 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.088437 Aug 24 09:47:37.230597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 777/1546] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:37.318200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:37.318813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:37.325736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:37.326218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:37.326651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:37.327343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:37.327818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:37.328244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:37.456391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:37.464724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aa9af9e1-4159-4505-b2eb-251765407db8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150361 Aug 24 09:47:37.467737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 770/1547] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:37 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:38.250973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:38.251608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:38.258581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:38.259060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:38.259495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:38.260215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:38.260669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:38.261093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:38.322901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:38.331104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ed9c1215-f6bd-4544-b0fe-38b147fcecac tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083977 Aug 24 09:47:38.331685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 778/1548] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:38.485487 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:38.486102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:38.493149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:38.493625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:38.494060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:38.494747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:38.495195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:38.495641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:38.625193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:38.627343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:38.633790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9914d0fb-12fd-47d0-9f6b-31e2d78964c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152132 Aug 24 09:47:38.634346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 771/1549] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:38 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:39.352353 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:39.352973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:39.359246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:39.359755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:39.360186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:39.360863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:39.361309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:39.361726 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:39.424161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:39.432832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c0a36b5f-efff-47c9-aead-db07263d3765 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084322 Aug 24 09:47:39.433390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 779/1550] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:39.664240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:39.664791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:39.671553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:39.672067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:39.672505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:39.673195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:39.673652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:39.674083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:39.802043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:39.810826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68894838-5176-48c1-b6cd-72f94620b515 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150616 Aug 24 09:47:39.811391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 772/1551] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:39 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:40.453872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:40.454476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:40.461225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:40.461696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:40.462129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:40.462808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:40.463258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:40.463715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:40.523494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:40.531629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ce553499-762f-487d-a41f-7256744f2ff9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081707 Aug 24 09:47:40.532248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 780/1552] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:40.831530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:40.832195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:40.838701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:40.839180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:40.839645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:40.840334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:40.840785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:40.841208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:40.967517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:40.976357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-33d4f944-6a4e-4e6e-a39e-ace7d02327cc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148013 Aug 24 09:47:40.976925 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 773/1553] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:40 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:41.553742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:41.554308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:41.560740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:41.561195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:41.561626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:41.562302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:41.562749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:41.563169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:41.623486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:41.631367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-69271d03-c117-43e0-b19f-77c30acd0577 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081598 Aug 24 09:47:41.632573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 781/1554] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:41.996957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:41.997483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:42.004076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:42.004555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:42.004985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:42.005664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:42.006112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:42.006531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:42.136943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:42.145083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cebf8824-8d94-4a68-a96f-576aff6bb336 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152074 Aug 24 09:47:42.145648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 774/1555] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:41 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:42.652544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:42.653151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:42.659400 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:42.659927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:42.660359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:42.661037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:42.661487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:42.661903 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:42.723043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:42.731501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e7cb0d67-4939-4dfb-bb1e-a3935a36d16b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082788 Aug 24 09:47:42.732090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 782/1556] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:43.166396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:43.166932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:43.173277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:43.173752 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:43.174215 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:43.174891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:43.175337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:43.175802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:43.301530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:43.309641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1c28ea1-50ca-46ce-951d-dfdca958a3ff tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147890 Aug 24 09:47:43.310200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 775/1557] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:43 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:43.752767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:43.753373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:43.760324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:43.760805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:43.761241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:43.761929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:43.762382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:43.762804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:43.826455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:43.835436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-47d56259-42b2-417d-90f9-291e78591c10 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086196 Aug 24 09:47:43.836015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 783/1558] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:44.330392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:44.331008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:44.338402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:44.338889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:44.339330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:44.340055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:44.340510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:44.340936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:44.469225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:44.477392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f4387c33-c0b6-4e50-b43b-28bf95e91241 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150953 Aug 24 09:47:44.477956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 776/1559] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:44 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:44.857262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:44.858079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:44.864936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:44.865472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:44.865921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:44.867348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:44.867948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:44.868413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:45.165509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:45.173852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b2b0fb0c-aa44-45fe-b88c-6904a9d4f26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.321209 Aug 24 09:47:45.176505 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 784/1560] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:45.498581 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:45.499092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:45.505570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:45.506052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:45.506493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:45.507780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:45.508240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:45.508667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:45.634412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:45.642429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-930bf39d-0d1b-4249-972d-16740cbd625c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147738 Aug 24 09:47:45.642991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 777/1561] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:45 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:46.195334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:46.196007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:46.202527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:46.203013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:46.203452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:46.204178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:46.204630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:46.205086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:46.264644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:46.272687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f7b22c26-ed24-4e22-8584-4eab52627681 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081817 Aug 24 09:47:46.273246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 785/1562] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:46.663781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:46.664355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:46.671113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:46.671606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:46.672044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:46.672985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:46.673438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:46.673858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:46.800954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:46.809711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-02318823-c501-4a6d-9717-1cfae8cbbedc tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151200 Aug 24 09:47:46.810271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 778/1563] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:46 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:47.293413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:47.294022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:47.300388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:47.304656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:47.304656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:47.304656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:47.304656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:47.305274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:47.317867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:47.364497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:47.372563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9222b222-71e6-4188-a574-6c02e5e336ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083119 Aug 24 09:47:47.373142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 786/1564] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:47.830382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:47.830998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:47.837649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:47.838130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:47.838567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:47.839260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:47.839745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:47.840176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:47.967819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:47.976041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-111b48a5-f185-43b8-99ad-0669010de8d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149558 Aug 24 09:47:47.976604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 779/1565] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:47 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:48.394074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:48.394682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:48.402048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:48.402518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:48.402947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:48.403646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:48.404096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:48.404515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:48.464093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:48.472077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ab2795ce-f239-4ea2-ad54-94d0e21fc778 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081853 Aug 24 09:47:48.472641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 787/1566] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:48.996811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:48.997417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:49.003707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:49.004179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:49.004607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:49.005282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:49.005728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:49.006150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:49.133551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:49.141893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e921b562-9f6e-4949-bcd0-abc14bf5f438 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148926 Aug 24 09:47:49.142451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 780/1567] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:48 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:49.493190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:49.493731 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:49.500197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:49.500681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:49.501120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:49.501813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:49.502269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:49.502696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:49.565864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:49.574539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-734629f5-e672-4b35-b385-aebfd7723c79 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085336 Aug 24 09:47:49.575101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 788/1568] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:50.163113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:50.163754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:50.170140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:50.170624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:50.171058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:50.171775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:50.172258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:50.172682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:50.450473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:50.458540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dd5bbbac-80eb-491e-9fd3-dbc0b7e45839 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.299326 Aug 24 09:47:50.459359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 781/1569] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:50 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:50.595313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:50.595885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:50.602696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:50.603179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:50.603639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:50.604326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:50.604779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:50.605205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:50.666437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:50.674587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4756fda1-95c9-428e-8a0f-5069a0532809 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083172 Aug 24 09:47:50.675151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 789/1570] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:51.478448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:51.479052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:51.485358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:51.485830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:51.486258 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:51.486939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:51.487385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:51.487831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:51.614650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:51.623395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9765f987-3fda-41e4-9199-4eeb434fb28e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148771 Aug 24 09:47:51.624269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 782/1571] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:51 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:51.694710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:51.695319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:51.701680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:51.702155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:51.702589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:51.703273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:51.703757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:51.704184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:51.764904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:51.773055 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-525b06cd-d39f-4d25-8efa-b10d57dae702 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082797 Aug 24 09:47:51.773622 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 790/1572] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:52.645145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:52.645717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:52.652614 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:52.653087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:52.653522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:52.654238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:52.654687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:52.655109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:52.785036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:52.793299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aa3d1538-9ff7-411f-a097-c68c2ad0c507 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152085 Aug 24 09:47:52.793496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:52.793956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 783/1573] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:52 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:52.794078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:52.800523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:52.801009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:52.801451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:52.802154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:52.802612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:52.803043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:52.866782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:52.875213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a41c8c27-9581-4acb-a252-6916dd955d21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085522 Aug 24 09:47:52.875805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 791/1574] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:53.813548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:53.814221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:53.821395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:53.821885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:53.822324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:53.823037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:53.823493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:53.823949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:53.896449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:53.897177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:53.903432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:53.903942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:53.904379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:53.905063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:53.905508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:53.905928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:53.951902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:53.960292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b16c549-5497-44e4-a058-2f72db21a25d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150626 Aug 24 09:47:53.960853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 784/1575] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:53 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:53.969681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:53.977905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b4770791-0190-42de-99fb-f3ad7e7a4509 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085390 Aug 24 09:47:53.978459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 792/1576] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:54.981110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:54.981735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:54.988588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:54.989071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:54.989531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:54.990218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:54.990669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:54.991090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:54.998286 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:54.998992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:55.005503 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:55.005992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:55.007059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:55.007808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:55.019927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:55.019927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:55.075748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:55.084166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d1a1b697-0d56-46b9-be07-8b6930a91bb6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.089594 Aug 24 09:47:55.085301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 793/1577] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:55.133091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:55.141157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-80068270-a6f6-4e06-bb62-fb712f1d27ea tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.163918 Aug 24 09:47:55.141702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 785/1578] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:54 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:56.105858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:56.106503 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:56.112995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:56.113473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:56.113904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:56.114590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:56.115042 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:56.115467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:56.162271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:56.163012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:56.169419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:56.169876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:56.170305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:56.170988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:56.171439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:56.171884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:56.176470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:56.185275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-87acdba3-6464-4918-a61b-e1e7bd8718f7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083301 Aug 24 09:47:56.185835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 794/1579] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:56.302207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:56.310820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-125a4a3b-8fc7-4c9a-9f5a-f4fc9febc595 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152470 Aug 24 09:47:56.311370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 786/1580] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:56 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:47:57.205604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:57.206241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:57.212991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:57.213470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:57.213907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:57.214590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:57.215042 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:57.215468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:57.274960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:57.282987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c45cb858-b0c2-477f-927b-2012866a68fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081257 Aug 24 09:47:57.283544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 795/1581] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:57.331304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:57.331942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:57.338589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:57.339093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:57.339530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:57.340235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:57.340694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:57.341113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:57.469487 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:57.478439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a8de96f7-50b4-4b71-a0ec-39db617ed1bf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150885 Aug 24 09:47:57.483687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 787/1582] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:57 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:58.303761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:58.304384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:58.310693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:58.311171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:58.311626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:58.312318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:58.312772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:58.313197 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:58.378577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:58.386955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9ca48271-c1c7-4e4c-8872-e4310632bc9b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087042 Aug 24 09:47:58.387521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 796/1583] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:58.502434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:58.503079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:58.510096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:58.510574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:58.511007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:58.511745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:58.512225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:58.512652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:58.527711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:47:58.642404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:58.651193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8d86888c-c891-4a0e-bb0c-f8244fa8b557 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152600 Aug 24 09:47:58.651778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 788/1584] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:58 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:59.409233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:59.409852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:59.416977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:59.417457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:59.417893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:59.418583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:59.419036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:59.419461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:59.483541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:59.492633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bb52b797-a4c1-4019-a86e-ddd5dd21da66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087361 Aug 24 09:47:59.493194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 797/1585] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:47:59.671355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:47:59.671918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:47:59.678160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:59.678667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:59.679098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:59.679805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:47:59.680260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:47:59.680679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:47:59.809791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:47:59.817818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2ce467f9-8ba9-4470-9fe0-f4663b84a8c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150345 Aug 24 09:47:59.818376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 789/1586] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:47:59 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:00.512801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:00.513419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:00.519376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:00.519897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:00.520347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:00.521038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:00.521498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:00.522430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:00.581651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:00.590494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-67d2c8ec-a823-47ab-ba12-8da23a502d75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081711 Aug 24 09:48:00.591059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 798/1587] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:00.838560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:00.839127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:00.845489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:00.845969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:00.846402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:00.847091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:00.847544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:00.847997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:00.973474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:00.981525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d02f8d98-d0d0-4b1a-b0ac-004b673fd3ca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147868 Aug 24 09:48:00.982083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 790/1588] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:00 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:01.460437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:48:01.460666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:48:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:48:01.759811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:01.760482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:01.766296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:01.766773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:01.767206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:01.767916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:01.768367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:01.768784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:01.828837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:01.837229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-00dc5a7f-a38a-4b4b-9f62-dff92d9308ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.229317 Aug 24 09:48:01.837784 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 799/1589] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:02.002085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:02.002620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:02.009761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:02.010245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:02.010687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:02.011379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:02.011889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:02.012320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:02.142049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:02.150750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ee2515d1-472e-4add-b23c-3a5f8e5f521c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152495 Aug 24 09:48:02.151315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 791/1590] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:01 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:02.858342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:02.928732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:02.928732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=56 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:02.928732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:02.928732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:02.929226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:02.929226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:02.929226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:02.929226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:02.932745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:02.941154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ce01d240-e9e3-432f-85a2-d477d7a13045 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086804 Aug 24 09:48:02.941710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 800/1591] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:03.171833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:03.172399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:03.179645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:03.180223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:03.180661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:03.181351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:03.181808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:03.182358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:03.310134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:03.318276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9f5ab1bb-33b4-4803-9334-14438c643ef7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150573 Aug 24 09:48:03.318832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 792/1592] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:03 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:03.962799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:03.963443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:03.969721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:03.970205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:03.970789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:03.971336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:03.971825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:03.972289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:04.032479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:04.041186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9b8f82d7-1f83-46a1-9759-2e2706772ca4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082867 Aug 24 09:48:04.041742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 801/1593] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:04.339804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:04.340421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:04.346691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:04.347161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:04.347604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:04.348287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:04.348738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:04.349156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:04.482345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:04.490372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-284d48dc-b72d-4244-a05d-3eab8557d9c2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154499 Aug 24 09:48:04.490929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 793/1594] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:04 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:05.061422 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:05.062065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:05.068580 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:05.069057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:05.069493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:05.070178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:05.070636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:05.071061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:05.130938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:05.139624 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-20bbc554-cd06-40f8-a0e3-ba827bee7bd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081995 Aug 24 09:48:05.144839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 802/1595] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:05.511465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:05.512038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:05.518435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:05.518915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:05.519349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:05.520084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:05.520542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:05.520965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:05.645713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:05.653805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2bb42f27-8e3f-468d-acb5-4fa20cbca772 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146232 Aug 24 09:48:05.654373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 794/1596] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:05 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:06.161128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:06.161749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:06.168762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:06.169242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:06.169678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:06.170367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:06.170819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:06.171239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:06.173789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:06.231896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:06.239834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d78cd99e-7d19-4d2a-9d19-5adb10857ea2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082519 Aug 24 09:48:06.241084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 803/1597] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:06.674947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:06.675516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:06.677809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:06.682479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:06.682958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:06.690860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:06.690860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:06.690860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:06.690860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:06.816580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:06.825159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-739ae743-f540-4ab4-ab4b-6c8568ed19ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154237 Aug 24 09:48:06.825749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 795/1598] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:06 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:07.261659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:07.262302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:07.268667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:07.269148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:07.269576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:07.270257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:07.270706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:07.271127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:07.336810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:07.345020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5a8f5c88-32e8-4427-9bc1-47d92e69dbe2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087242 Aug 24 09:48:07.345578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 804/1599] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:07.846637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:07.847250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:07.853561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:07.854037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:07.854471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:07.855150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:07.855625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:07.856114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:07.981981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:07.990584 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-de576a89-3ab1-436f-8668-2c2a9d4333ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147334 Aug 24 09:48:07.991140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 796/1600] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:07 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:08.366805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:08.367414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:08.373695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:08.374171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:08.374602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:08.375279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:08.375756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:08.376175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:08.437420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:08.445403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d0d9d957-4904-4633-8282-4a9351e50a5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083085 Aug 24 09:48:08.445965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 805/1601] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:09.011869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:09.012488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:09.018824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:09.019298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:09.019757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:09.020450 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:09.020902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:09.022144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:09.149136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:09.157265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-86b863e8-f410-4bed-a423-7494ee639084 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149404 Aug 24 09:48:09.157833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 797/1602] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:09 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:09.466045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:09.466669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:09.473202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:09.473688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:09.474127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:09.475459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:09.475948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:09.476376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:09.535934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:09.544680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7ed2195d-8aa0-4278-9d11-47d968f440ce tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082553 Aug 24 09:48:09.545236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 806/1603] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:10.179047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:10.179676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:10.185983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:10.186456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:10.186887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:10.187568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:10.188042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:10.192417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:10.319934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:10.328166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d7ac5157-d579-4aea-b3c2-94c541c07169 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153488 Aug 24 09:48:10.328729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 798/1604] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:10 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:10.565370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:10.565923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:10.572230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:10.572703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:10.573135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:10.573809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:10.574254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:10.574670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:10.634003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:10.641974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-39e11de2-5e83-4d1c-b392-c4ce887cee12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.080545 Aug 24 09:48:10.642524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 807/1605] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:10.960250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:48:10.960477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:48:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:48:11.348763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:11.349363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:11.355694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:11.356172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:11.356608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:11.357341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:11.357790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:11.358213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:11.484078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:11.492153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-467ba70f-25bc-40e3-beb6-c5c6b4aae33c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147277 Aug 24 09:48:11.492710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 799/1606] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:11 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:11.662213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:11.662829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:11.669219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:11.669705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:11.670143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:11.670834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:11.671293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:11.671756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:11.735775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:11.743998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5cbc88dd-85cb-4a21-af82-ead5af9dae32 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085633 Aug 24 09:48:11.744559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 808/1607] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:12.512720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:12.513331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:12.519886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:12.520291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:12.520728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:12.521931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:12.522384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:12.522811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:12.655052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:12.663786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d7fa0572-5374-4ad5-a02c-bdfd43b4e42d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154930 Aug 24 09:48:12.664344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 800/1608] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:12 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:12.764802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:12.765449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:12.772667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:12.773178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:12.773618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:12.774311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:12.774765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:12.775192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:12.837312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:12.845290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eb5af89e-cd61-456f-ad2c-ed92979ab620 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084466 Aug 24 09:48:12.845851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 809/1609] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:13.684741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:13.685363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:13.691778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:13.692265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:13.692707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:13.693976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:13.694437 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:13.694867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:13.827000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:13.836031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b2ca21dc-8a3d-47e0-98fa-6270128e89b7 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155147 Aug 24 09:48:13.836593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 801/1610] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:13 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:13.866623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:13.867245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:13.873646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:13.874132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:13.874570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:13.875261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:13.875755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:13.876185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:13.937895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:13.946506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eb1380df-29d3-4c8e-a857-e510b3925dfa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084270 Aug 24 09:48:13.947067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 810/1611] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:14.856060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:14.856702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:14.863011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:14.863500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:14.864016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:14.864697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:14.865653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:14.866072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:14.966283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:14.967033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:14.975602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:14.976310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:14.976747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:14.977452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:14.977911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:14.978336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:14.996536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:15.005516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c9f0b827-aea4-4667-91b1-4b3c2df77090 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153237 Aug 24 09:48:15.007629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 802/1612] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:14 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:15.044627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:15.053585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-501d3739-9911-43b0-b269-30ae28b4bb63 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.091274 Aug 24 09:48:15.054446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 811/1613] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:16.027732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:16.028407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:16.034804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:16.035280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:16.035746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:16.036431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:16.036928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:16.037354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:16.074562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:16.075442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:16.081867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:16.082363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:16.082802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:16.084142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:16.084610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:16.085043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:16.149023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:16.157311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1f988342-958b-453d-9f38-dc76aa4f67c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086550 Aug 24 09:48:16.157886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 812/1614] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:16.169626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:16.179060 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1670da82-f7fe-4a7b-b679-5d3a5cb6a54e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155166 Aug 24 09:48:16.179934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 803/1615] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:16 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:17.180210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:17.180830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:17.187228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:17.187750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:17.188210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:17.188881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:17.189333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:17.189758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:17.201455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:17.204240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:17.209438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:17.209919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:17.210361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:17.211119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:17.211508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:17.211953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:17.253880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:17.262122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5f71c66e-9108-4ee0-9aa1-85367702b19b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086379 Aug 24 09:48:17.262691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 813/1616] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:17.342157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:17.350831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b8efd320-41bd-462c-9fd2-2cbdfd48f248 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153623 Aug 24 09:48:17.351397 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 804/1617] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:17 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:18.282233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:18.282898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:18.290001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:18.290415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:18.290845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:18.291530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:18.292004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:18.292431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:18.356008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:18.362051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1d76ebd2-8b07-4aa3-893e-b04596cc5e12 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083659 Aug 24 09:48:18.362667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 814/1618] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:18.371622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:18.372323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:18.379066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:18.379549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:18.380016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:18.380746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:18.381201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:18.381629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:18.385691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:18.512189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:18.520250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7236129d-1843-4835-ac12-e4ea3c8209a6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152448 Aug 24 09:48:18.520814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 805/1619] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:18 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:19.384314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:19.384923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:19.391192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:19.392021 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:19.392455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:19.393136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:19.393587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:19.394008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:19.453364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:19.461676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-12242a37-bcec-40aa-899a-327097ed1cdd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081882 Aug 24 09:48:19.462225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 815/1620] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:19.541948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:19.542552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:19.548893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:19.549367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:19.549799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:19.550479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:19.550930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:19.551348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:19.678981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:19.687032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4fdb9738-3c3a-4946-9171-caab8e5c34ce tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148952 Aug 24 09:48:19.687601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 806/1621] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:19 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:20.482740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:20.483361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:20.489715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:20.490198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:20.490636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:20.491326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:20.491803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:20.492231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:20.554612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:20.562747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6d934e1a-01ca-43f6-81ed-0d6248031442 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083892 Aug 24 09:48:20.563302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 816/1622] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:20.707724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:20.708338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:20.714988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:20.715467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:20.715936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:20.716626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:20.717080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:20.717506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:20.846882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:20.855105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0f85beef-acf4-443f-a370-a5b914f3bd60 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151319 Aug 24 09:48:20.855688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 807/1623] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:20 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:21.584426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:21.584980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:21.591321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:21.591833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:21.592276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:21.592964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:21.593416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:21.593837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:21.655257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:21.664060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3e89c2e7-1de0-4d0a-80fe-9dad52e7da9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084057 Aug 24 09:48:21.664619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 817/1624] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:21.876371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:21.876897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:21.883225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:21.883773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:21.884214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:21.884907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:21.885424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:21.885790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:22.010001 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:22.018076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f00be7dd-f218-43c8-bd05-b65f18cacad8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.145673 Aug 24 09:48:22.018641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 808/1625] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:21 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:22.684399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:22.685012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:22.691542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:22.692045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:22.692503 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:22.693710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:22.694159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:22.694599 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:22.754956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:22.763872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-55644bf8-1b1c-4496-9ab8-ff1ef36f8881 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083465 Aug 24 09:48:22.764430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 818/1626] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:23.038817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:23.039463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:23.045876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:23.046358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:23.046801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:23.047490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:23.047975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:23.048406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:23.172267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:23.180817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8cec41ee-a477-4e54-ad50-a6174a01820f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.145834 Aug 24 09:48:23.181376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 809/1627] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:23 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:23.785074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:23.785724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:23.792181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:23.792662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:23.793101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:23.793788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:23.794240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:23.794663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:23.855097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:23.857336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:23.864018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-99597e83-f22e-4829-b54b-2cb6fcb44ff3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082736 Aug 24 09:48:23.865264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 819/1628] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:24.202834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:24.203453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:24.210145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:24.210625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:24.211066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:24.211815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:24.212273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:24.212702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:24.344897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:24.353516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a4845cc4-0610-4a61-bdec-a3ef645ffe82 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154617 Aug 24 09:48:24.354069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 810/1629] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:24 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:24.885328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:24.885918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:24.892729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:24.893201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:24.893632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:24.894318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:24.894760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:24.895175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:24.958848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:24.967134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-298a9a75-68ff-4d83-be1b-8d3d5f8652ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085726 Aug 24 09:48:24.967711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 820/1630] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:25.374273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:25.374888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:25.381904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:25.382383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:25.382818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:25.383506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:25.383988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:25.384421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:25.509488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:25.517602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a31e9fe5-a6f9-4814-93d5-503fdf2cadfd tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147170 Aug 24 09:48:25.518164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 811/1631] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:25 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:25.987364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:25.987984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:25.994894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:25.995374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:25.995846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:25.996535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:25.996987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:25.997411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:26.057414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:26.065410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bdb4224b-0b23-4385-aa06-9d91864e67e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081887 Aug 24 09:48:26.065967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 821/1632] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:26.538878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:26.539485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:26.546000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:26.546473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:26.546904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:26.547603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:26.548068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:26.548491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:26.678296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:26.686347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-65cd1c56-2059-492f-a10e-d3cb3b5bf1cf tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151881 Aug 24 09:48:26.686897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 812/1633] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:26 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:27.087294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:27.088009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:27.094472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:27.094955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:27.095390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:27.096106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:27.096558 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:27.096980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:27.157751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:27.165905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8463a13a-6812-4ecc-8476-b7292bc5ba9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083319 Aug 24 09:48:27.166466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 822/1634] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:27.707561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:27.708153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:27.714679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:27.715150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:27.715597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:27.716288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:27.716736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:27.717155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:27.844517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:27.853171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-15648a8d-c607-4cf3-8179-7ffe4efdbe3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149626 Aug 24 09:48:27.853734 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 813/1635] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:27 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:28.187161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:28.187813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:28.194245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:28.194732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:28.195173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:28.195901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:28.196363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:28.196794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:28.259294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:28.267373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4c32e713-04c1-4230-b62c-7d99e85af93f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084097 Aug 24 09:48:28.267965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 823/1636] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:28.874408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:28.875017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:28.881531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:28.882015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:28.882457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:28.883146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:28.883619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:28.884057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:29.011400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:29.019743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-77079646-1617-4795-89a2-c1285d9de6d5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149312 Aug 24 09:48:29.020308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 814/1637] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:28 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:29.288857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:29.289448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:29.295922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:29.296400 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:29.296833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:29.297516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:29.297966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:29.298385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:29.368072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:29.372553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-06cf2eb7-e69f-4d37-b144-573e10b17bd0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087666 Aug 24 09:48:29.373128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 824/1638] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:30.040624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:30.041263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:30.047721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:30.048201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:30.048641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:30.049327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:30.049776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:30.050198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:30.177974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:30.186122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2b21d86d-db41-4405-b262-3400c0cc3b34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149416 Aug 24 09:48:30.186684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 815/1639] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:30 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:30.393534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:30.394147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:30.400026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:30.400502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:30.400932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:30.401607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:30.402051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:30.402874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:30.462569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:30.470682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-aed84cc2-04b5-415d-9b65-0ecb5594ca88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081075 Aug 24 09:48:30.471234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 825/1640] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:31.207038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:31.208295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:31.214809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:31.215290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:31.215769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:31.216459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:31.216913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:31.217339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:31.344167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:31.353004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5940f6af-5971-4baa-8a78-f15e00bd348e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149832 Aug 24 09:48:31.353564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 816/1641] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:31 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:31.491293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:31.491882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:31.498257 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:31.498732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:31.499161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:31.499867 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:31.500314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:31.500736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:31.561126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:31.569714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8b9423f6-8e48-4fbf-9f36-95572c313ab4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082317 Aug 24 09:48:31.570276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 826/1642] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:32.373688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:32.374311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:32.381167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:32.381650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:32.382084 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:32.382772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:32.383226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:32.383677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:32.512240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:32.520319 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-45c8821b-af30-460a-ad00-ce262afc409e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150505 Aug 24 09:48:32.520882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 817/1643] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:32 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:32.590684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:32.591195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:32.597199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:32.597682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:32.598112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:32.598797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:32.599238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:32.599680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:32.659712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:32.667894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c60db6dc-c53a-4dc9-b864-f7389518e789 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081088 Aug 24 09:48:32.668447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 827/1644] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:33.542575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:33.543207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:33.549505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:33.549980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:33.550491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:33.551182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:33.551685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:33.552114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:33.678528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:33.686853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-40caa08a-d1b1-40b9-aee1-1bafaae46c7d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148121 Aug 24 09:48:33.687410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 818/1645] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:33 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:33.690125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:33.690734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:33.697714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:33.698204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:33.698631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:33.699312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:33.699802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:33.700222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:33.763315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:33.771412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e9c22551-0208-47b2-a03a-86e27ab0471f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085078 Aug 24 09:48:33.771994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 828/1646] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:34.708961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:34.709510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:34.715837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:34.716311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:34.716741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:34.717421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:34.717867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:34.718286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:34.792455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:34.793579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:34.795865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=58 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:34.800939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:34.801418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:34.801849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:34.803205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:34.803683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:34.804108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:34.848582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:34.857380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-30d3c189-399d-4879-aef0-2f886f17a1f6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152633 Aug 24 09:48:34.857938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 819/1647] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:34 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:34.865196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:34.873450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d660a9cd-6779-487f-8ebc-e0c28cee5fb5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084805 Aug 24 09:48:34.874005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 829/1648] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:35.878362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:35.878949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:35.885974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:35.886448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:35.886878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:35.887551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:35.888038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:35.888458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:35.893858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:35.894613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:35.900973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:35.901453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:35.901881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:35.902566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:35.903010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:35.903430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:35.973876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:35.982936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a78a7ba1-ce27-4eb5-982f-552c2affc946 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.092820 Aug 24 09:48:35.983509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 830/1649] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:36.018975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:36.027053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2a8fccbe-33bc-4434-8b7a-7961bdaaa81c tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152567 Aug 24 09:48:36.027692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 820/1650] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:35 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:37.004064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:37.004683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:37.011111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:37.011609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:37.012051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:37.012739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:37.013191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:37.013612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:37.048401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:37.049131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:37.051624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:37.057501 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:37.057992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:37.058465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:37.059172 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:37.059657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:37.060089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:37.074873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:37.082980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7b094fb0-3410-4f23-9121-0db039b3ea33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082757 Aug 24 09:48:37.083823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 831/1651] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:37.188917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:37.195496 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:37.198255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-09dba845-c85d-4134-8618-dc2d7704dd85 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153700 Aug 24 09:48:37.198819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 821/1652] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:37 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:38.105047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:38.105653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:38.112050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:38.112528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:38.112958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:38.113638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:38.114083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:38.114504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:38.177482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:38.185646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0941029c-0b48-4e03-a819-57831a595aee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084456 Aug 24 09:48:38.186205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 832/1653] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:38.220440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:38.221134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:38.228326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:38.228796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:38.229225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:38.229901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:38.230352 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:38.230770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:38.358329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:38.366465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-41fffdbc-c2aa-44d9-b2cd-2f11a1e8cb07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150205 Aug 24 09:48:38.367024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 822/1654] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:38 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:39.205654 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:39.206283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:39.212953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:39.213439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:39.213882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:39.214570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:39.215025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:39.215452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:39.275242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:39.283282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1b73e1e1-d1a8-48ff-9d6e-6797a35835f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081603 Aug 24 09:48:39.283881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 833/1655] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:39.387705 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:39.388318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:39.394680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:39.395161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:39.395611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:39.396306 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:39.396763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:39.397189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:39.529113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:39.537087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-51f653af-300b-473b-a4a9-fe4708bcdd27 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153309 Aug 24 09:48:39.537643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 823/1656] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:39 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:40.305050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:40.305672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:40.312434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:40.312911 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:40.313344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:40.314037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:40.314489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:40.314910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:40.375577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:40.383651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a60841b3-fd6e-4589-b84f-108bf2f67a1a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082704 Aug 24 09:48:40.384208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 834/1657] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:40.557696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:40.558273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:40.564788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:40.565279 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:40.565725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:40.566421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:40.566901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:40.567328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:40.696901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:40.704964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b22cd05-3a98-4538-ae85-b083b656733e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151253 Aug 24 09:48:40.705532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 824/1658] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:40 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:41.404919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:41.405540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:41.412538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:41.413001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:41.413439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:41.414139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:41.414601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:41.415026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:41.475779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:41.483869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-16e2c9f0-e942-49cb-97ec-3bd44be3f932 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082888 Aug 24 09:48:41.484432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 835/1659] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:41.727260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:41.727846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:41.734434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:41.734910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:41.735346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:41.736067 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:41.736516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:41.736935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:41.863264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:41.871329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d96b5748-5f83-4fda-b433-da25b08bc54a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148700 Aug 24 09:48:41.871911 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 825/1660] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:41 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:42.505148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:42.505763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:42.512309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:42.512796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:42.513232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:42.513933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:42.514388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:42.514815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:42.529032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:42.577970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:42.586284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f6df6ed1-730a-498d-9ad9-95a5630be8d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085068 Aug 24 09:48:42.586846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 836/1661] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:42.891868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:42.892419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:42.899240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:42.899754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:42.900193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:42.900882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:42.901337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:42.901761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:43.033832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:43.042581 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6eed7dc1-d711-4805-9eb4-59fff733653a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154655 Aug 24 09:48:43.043261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 826/1662] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:42 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:43.606632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:43.607185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:43.613505 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:43.613986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:43.614423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:43.615108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:43.615561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:43.616008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:43.677755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:43.685818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-707864bc-740e-48ee-9df6-b6bd85333ab9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083204 Aug 24 09:48:43.686378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 837/1663] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:44.063729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:44.064394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:44.071263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:44.071775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:44.072205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:44.072909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:44.073356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:44.073771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:44.197959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:44.205955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-13494ca1-450b-4aa9-9f30-2f04a06ddd83 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146075 Aug 24 09:48:44.206523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 827/1664] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:44 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:44.706382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:44.706954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:44.714161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:44.714655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:44.715073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:44.715788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:44.716240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:44.716663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:44.776632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:44.784806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-008079bf-2685-470d-b56c-2b5db15c9bb1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082404 Aug 24 09:48:44.785362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 838/1665] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:45.228081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:45.228697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:45.235047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:45.235560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:45.236030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:45.236723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:45.237183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:45.237608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:45.365936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:45.374093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-005465b6-698f-4d6c-9b41-6dde822ce274 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150537 Aug 24 09:48:45.374661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 828/1666] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:45 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:45.805807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:45.806457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:45.812884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:45.813363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:45.813801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:45.814484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:45.814938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:45.815363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:45.875659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:45.884957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f65bbff7-5951-40f7-ab24-562a57eb62a2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083539 Aug 24 09:48:45.885523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 839/1667] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:46.394717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:46.395328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:46.401683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:46.402166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:46.402606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:46.403301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:46.403790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:46.404222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:46.532332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:46.540381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-afd4831d-6e94-4c13-8fc0-c479ebe8e488 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149755 Aug 24 09:48:46.540957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 829/1668] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:46 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:46.905548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:46.906158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:46.913011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:46.913486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:46.913914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:46.914592 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:46.915037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:46.915456 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:46.979103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:46.987174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-efc7162f-76a5-464f-a410-ca0277bd7be8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085546 Aug 24 09:48:46.987760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 840/1669] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:47.561644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:47.562222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:47.568802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:47.569498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:47.570038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:47.570729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:47.571189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:47.571634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:47.700162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:47.708183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cf81f632-c472-41f8-a60e-f112e4517624 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150531 Aug 24 09:48:47.709602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 830/1670] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:47 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:48.008688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:48.009262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:48.015563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:48.016072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:48.016511 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:48.017202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:48.017655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:48.018084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:48.078394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:48.087214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-28635268-ef75-4f42-a61b-05c329315aa3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082997 Aug 24 09:48:48.087810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 841/1671] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:48.730305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:48.730946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:48.737312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:48.737803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:48.738219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:48.738901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:48.739346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:48.739798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:48.871013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:48.879234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-762bf305-d444-4d17-b590-286c85ab49ec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152853 Aug 24 09:48:48.879905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 831/1672] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:48 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:49.108158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:49.108767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:49.115161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:49.116241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:49.116677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:49.117354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:49.117801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:49.118222 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:49.177252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:49.185795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d70fd5f2-d1e1-4faf-b1c3-9375b9bb9b33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081470 Aug 24 09:48:49.186348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 842/1673] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:49.900737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:49.901354 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:49.907783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:49.908271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:49.908711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:49.909405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:49.909862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:49.910294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:50.036793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:50.045472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-21c880b6-d26b-4958-af48-5741df482a7e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148681 Aug 24 09:48:50.046040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 832/1674] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:49 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:50.205964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:50.206515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:50.213623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:50.214100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:50.214533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:50.215216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:50.215700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:50.216126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:50.277982 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:50.286052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0d309e92-ffa2-4449-ae0f-b4973df0c07a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084005 Aug 24 09:48:50.286606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 843/1675] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:51.066861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:51.067499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:51.074553 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:51.075042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:51.075482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:51.076203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:51.076663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:51.077094 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:51.204655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:51.213185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-db874bb2-11b2-4c37-9415-5e4a041d7011 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150182 Aug 24 09:48:51.213782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 833/1676] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:51 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:51.307828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:51.308481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:51.314846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:51.315328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:51.315800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:51.316482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:51.316987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:51.317356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:51.381949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:51.390125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-676d75f1-2212-45de-9a27-30c8f7ed556b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086269 Aug 24 09:48:51.390683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 844/1677] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:52.233890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:52.234505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:52.241757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:52.242238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:52.242676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:52.243371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:52.243854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:52.244284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:52.373821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:52.382006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-95aca84d-cd23-43e0-bef2-62c1f36be0e8 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151927 Aug 24 09:48:52.382572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 834/1678] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:52 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:52.410116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:52.410733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:52.417579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:52.418056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:52.418496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:52.419186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:52.419665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:52.420094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:52.481267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:52.489320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e28429fa-d442-4322-a26b-a380d45c2efd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083050 Aug 24 09:48:52.489876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 845/1679] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:53.402469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:53.403086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:53.409484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:53.409967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:53.410410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:53.411101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:53.411559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:53.412587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:53.510282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:53.510925 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:53.517577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:53.518063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:53.518528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:53.519216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:53.519708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:53.520163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:53.540272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:53.549036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-53a87873-d80d-4a63-adac-8dddedcf4989 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150393 Aug 24 09:48:53.549616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 835/1680] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:53 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:53.588351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:53.596557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-efad53e0-20c8-467d-a105-28beb0f53626 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.090152 Aug 24 09:48:53.597115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 846/1681] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:54.570519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:54.571133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:54.577531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:54.578008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:54.578438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:54.579115 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:54.579564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:54.580007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:54.617581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:54.618306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:54.624964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:54.625450 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:54.626011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:54.626747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:54.627194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:54.627635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:54.689649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:54.698479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9c5b0786-5ff3-4d4a-8f2c-5e13e9dc001a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084678 Aug 24 09:48:54.699178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 847/1682] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:54.712128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:54.720491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c1b6c7ff-0ae0-4930-a4fb-54b6d8149cca tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154364 Aug 24 09:48:54.721044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 836/1683] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:54 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:55.720136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:55.720759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:55.727738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:55.728219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:55.728639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:55.729315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:55.729763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:55.730180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:55.741131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:55.741739 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:55.748013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:55.748486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:55.748917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:55.749596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:55.750042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:55.750465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:55.794294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:55.802599 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-68732f45-b054-487c-8feb-b73b5e75acd5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086403 Aug 24 09:48:55.803152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 848/1684] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:55.878554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:55.887149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-45d750f6-6ca2-4eaf-a4b7-8cc590a0bb19 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149775 Aug 24 09:48:55.887740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 837/1685] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:55 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:48:56.823666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:56.824281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:56.830617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:56.831090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:56.831521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:56.832225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:56.832670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:56.833087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:56.894217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:56.902960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-275f84a8-1280-4667-8bb4-3e1dfbce3b13 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083184 Aug 24 09:48:56.903739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 849/1686] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:56.908517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:56.909127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:56.916647 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:56.922431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:56.922431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:56.922431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:56.922431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:56.922856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:56.933185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:48:57.047273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:57.056091 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cea27ae0-4841-4891-8b14-17f184535b7f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151321 Aug 24 09:48:57.056655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 838/1687] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:56 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:57.923242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:57.923960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:57.930650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:57.931123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:57.931553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:57.932254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:57.932701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:57.933120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:58.046632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:58.055335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6f828cfb-d9bf-4e00-8e19-714c33c1d8af tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.135896 Aug 24 09:48:58.055938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 850/1688] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:58.077207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:58.077821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:58.084509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:58.084990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:58.085428 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:58.086120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:58.086575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:58.087008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:58.213028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:58.221155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b3a22c81-2fbb-4a69-ad05-93404562cfec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147764 Aug 24 09:48:58.221736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 839/1689] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:58 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:59.076356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:59.076950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:59.083327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:59.084090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:59.084525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:59.085210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:59.085661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:59.086084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:59.146822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:59.155875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bc94bcd7-d108-4490-b6bf-6f92c598269c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083313 Aug 24 09:48:59.156438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 851/1690] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:48:59.243103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:48:59.243768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:48:59.249693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:59.250173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:59.250609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:59.251295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:48:59.251781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:48:59.252208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:48:59.419881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:48:59.428470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-904073ba-99f7-4338-b143-41a5b38ee7ef tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.190010 Aug 24 09:48:59.429029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 840/1691] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:48:59 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:00.176303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:00.176913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:00.183475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:00.183990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:00.184429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:00.185117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:00.185569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:00.185993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:00.251006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:00.259202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b4b69152-3c77-4b4c-a16a-1e0569df289d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086960 Aug 24 09:49:00.259788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 852/1692] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:00.449255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:00.449868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:00.456273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:00.456755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:00.457190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:00.457879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:00.458330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:00.459515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:00.587311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:00.595394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-744c642c-8fad-4ba2-97a2-3ec6827851a9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150094 Aug 24 09:49:00.595986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 841/1693] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:00 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:01.279857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:01.280485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:01.286871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:01.287355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:01.293865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:01.293865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:01.293865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:01.293865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:01.294300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:01.353108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:01.361453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9e429b88-fe7e-4742-8d14-13f0b72c533b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085497 Aug 24 09:49:01.362017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 853/1694] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:01.618166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:01.618726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:01.625087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:01.625560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:01.625992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:01.626676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:01.627124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:01.627546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:01.754231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:01.762333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b0405fb6-3283-4170-914b-65ad29dfa57e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149358 Aug 24 09:49:01.762898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 842/1695] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:01 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:02.382892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:02.383441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:02.389846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:02.390325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:02.390763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:02.391452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:02.391957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:02.392390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:02.452676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:02.461728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d69e5dcc-6795-4eca-bb1b-c54afd13641a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083285 Aug 24 09:49:02.462291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 854/1696] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:02.783240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:02.783941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:02.790866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:02.791343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:02.791815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:02.792511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:02.792964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:02.793386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:02.924657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:02.932834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6ac4b442-5ec9-4cd6-8db5-8575ba127b75 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153455 Aug 24 09:49:02.933394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 843/1697] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:02 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:03.481959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:03.482537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:03.489026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:03.489510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:03.489948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:03.490645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:03.491105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:03.491551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:03.553979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:03.562187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0b05ecd0-1d90-47d1-a1da-a50c31537478 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084202 Aug 24 09:49:03.562869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 855/1698] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:03.953574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:03.954108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:03.961327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:03.961807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:03.962248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:03.962932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:03.963393 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:03.963851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:04.096229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:04.104366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-52700b5c-8b5b-4dd0-af98-a5e401c42be2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154804 Aug 24 09:49:04.104935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 844/1699] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:03 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:04.582716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:04.583351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:04.590462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:04.590947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:04.591387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:04.592121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:04.592564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:04.592990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:04.656344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:04.664338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6fb98da4-5897-41ea-afbe-6c6277f2f21f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085589 Aug 24 09:49:04.664901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 856/1700] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:05.125679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:05.126326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:05.132720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:05.133198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:05.133636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:05.134321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:05.134778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:05.135206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:05.260590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:05.268707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-79f2e799-cc04-4f7b-844d-0d48f790f3bb tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146959 Aug 24 09:49:05.269283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 845/1701] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:05 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:05.684812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:05.685430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:05.687709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=56 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:05.692375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:05.692853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:05.693288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:05.693975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:05.694427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:05.694853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:05.757509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:05.765779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bd308ec3-47e2-4ef9-8d2a-1db57c2e0199 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084840 Aug 24 09:49:05.766346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 857/1702] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:06.290536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:06.291147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:06.297493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:06.297977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:06.298411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:06.299100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:06.299548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:06.299991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:06.429589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:06.437663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-002089fb-ffa5-44b8-90a7-63706220e1ed tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151517 Aug 24 09:49:06.438255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 846/1703] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:06 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:06.786757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:06.787368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:06.793788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:06.794264 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:06.794693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:06.795372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:06.795851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:06.796282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:06.856923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:06.865714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a80bb208-de65-4261-9286-4a86602e9dc9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082895 Aug 24 09:49:06.866274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 858/1704] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:07.457943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:07.459237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:07.461540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:07.466241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:07.466718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:07.467169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:07.467896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:07.468347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:07.468807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:07.595037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:07.603126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fa8cd5c8-f04f-4148-b1d1-32b8e105486e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149103 Aug 24 09:49:07.603710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 847/1705] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:07 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:07.886739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:07.887354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:07.893728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:07.894205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:07.894639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:07.895324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:07.895806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:07.896231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:07.956949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:07.965335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cbd17f54-4522-44cd-9ee1-7e9099952078 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082530 Aug 24 09:49:07.965899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 859/1706] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:08.623952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:08.624524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:08.630980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:08.631455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:08.631916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:08.632594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:08.633041 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:08.633465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:08.762078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:08.770298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d39c250a-83ff-40d0-9a0c-639d89a62162 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150406 Aug 24 09:49:08.771421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 848/1707] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:08 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:08.985876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:08.986408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:08.992823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:08.993304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:08.993740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:08.994429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:08.994881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:08.995306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:09.058540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:09.066606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6a75fb8d-6c88-4d93-b51e-c7f3b256269e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084786 Aug 24 09:49:09.067162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 860/1708] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:09.792282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:09.792898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:09.799438 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:09.799941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:09.800410 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:09.801097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:09.801546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:09.801966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:09.926012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:09.934402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7190dd89-9844-4b98-a74f-b8e38a9724ee tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146060 Aug 24 09:49:09.934966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 849/1709] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:09 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:10.088129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:10.088747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:10.095394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:10.095912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:10.096350 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:10.097037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:10.097489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:10.097914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:10.157560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:10.165607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7c408747-bacb-4c94-b8eb-3ca2b8843bad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081348 Aug 24 09:49:10.166166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 861/1710] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:10.955764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:10.956403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:10.963516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:10.964031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:10.964581 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:10.965920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:10.966405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:10.966841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:11.101689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:11.110495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1b7635a-9f5e-410a-8020-25c815a60696 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.158632 Aug 24 09:49:11.111062 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 850/1711] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:10 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:11.186628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:11.187246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:11.197156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:11.197637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:11.198080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:11.198777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:11.199232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:11.199700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:11.262236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:11.271395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-297cbb9c-58dd-468f-8b08-b3fd8fd76660 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.088054 Aug 24 09:49:11.272118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 862/1712] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:12.131991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:12.132602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:12.138934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:12.139407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:12.139873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:12.140557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:12.141010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:12.141433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:12.265922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:12.274547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-50212943-233e-453b-8370-2a3291360eba tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147044 Aug 24 09:49:12.275112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 851/1713] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:12 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:12.291192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:12.291836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:12.298156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:12.298635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:12.299071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:12.299786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:12.300245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:12.300669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:12.363173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:12.371871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ec6cf862-6489-45dc-868f-cdfb10502093 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084493 Aug 24 09:49:12.372432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 863/1714] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:13.295123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:13.295770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:13.302685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:13.303161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:13.303616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:13.304296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:13.304743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:13.305163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:13.393357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:13.393976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:13.400303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:13.400783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:13.401219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:13.401912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:13.402370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:13.402796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:13.433808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:13.442166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fd2fd256-bc67-45f9-9fcc-a5c6f8a39bc6 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150868 Aug 24 09:49:13.443313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 852/1715] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:13 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:13.477658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:13.477658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-83dc27b4-babf-436e-959d-e24d11d82bc5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087798 Aug 24 09:49:13.477910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 864/1716] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:14.464634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:14.465213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:14.471566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:14.472075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:14.472510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:14.473195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:14.473654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:14.474080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:14.498239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:14.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:14.505932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:14.506415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:14.506843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:14.507625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:14.508081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:14.508503 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:14.571027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:14.579178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c1e6507f-b53c-4a5d-9410-dc6fd7aec855 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084837 Aug 24 09:49:14.579769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 865/1717] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:14.604182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:14.612161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-97e6c81d-5194-4360-94c6-afb09f266fc2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151560 Aug 24 09:49:14.612714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 853/1718] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:14 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:15.600816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:15.601351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:15.607741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:15.608231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:15.608660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:15.609345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:15.609798 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:15.610220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:15.633910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:15.634703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:15.640970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:15.641448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:15.641877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:15.642563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:15.643011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:15.643433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:15.670671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:15.679596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2294ccae-d427-4aaf-8b9f-c1d64c74adc1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082804 Aug 24 09:49:15.680184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 866/1719] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:15.772634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:15.780844 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-453adef4-3ae9-4067-9d7d-a8abf4af8625 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151398 Aug 24 09:49:15.781416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 854/1720] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:15 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:16.700646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:16.701290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:16.707674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:16.709017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:16.709447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:16.710136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:16.710579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:16.710994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:16.772755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:16.781101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2b8fc64b-d354-430a-ab90-1ab9ac71d0ad tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084524 Aug 24 09:49:16.781674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 867/1721] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:16.804984 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:16.812947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:16.813116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:16.813451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:16.813879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:16.814572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:16.815021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:16.815447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:16.820080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:16.948361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:16.956455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f10b88fd-7c7a-4f98-8720-7b848a913521 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.155483 Aug 24 09:49:16.957020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 855/1722] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:16 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:17.801320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:17.802498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:17.808908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:17.809392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:17.809833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:17.810524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:17.811009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:17.811436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:17.875850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:17.884727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-051a06ad-edde-4196-bff4-78d6b82ca628 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087244 Aug 24 09:49:17.885294 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 868/1723] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:17.977848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:17.978473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:17.984896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:17.985380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:17.985819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:17.986511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:17.986968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:17.987428 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:18.114781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:18.122933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f3a7a314-903a-434d-86de-cdc710120390 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149487 Aug 24 09:49:18.123508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 856/1724] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:17 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:18.905280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:18.905899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:18.912296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:18.912812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:18.913248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:18.913932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:18.914387 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:18.914812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:18.977374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:18.979534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:18.986044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d65d5b01-8417-4c11-933c-4afb94d89f60 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084666 Aug 24 09:49:18.989552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 869/1725] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:19.143555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:19.144189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:19.150579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:19.151053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:19.151482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:19.152256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:19.152704 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:19.153123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:19.277083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:19.285102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-18d23d05-08f8-4138-a801-0713b2b08d07 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.145450 Aug 24 09:49:19.285660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 857/1726] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:19 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:20.006290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:20.006910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:20.014098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:20.014588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:20.015028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:20.015772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:20.016230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:20.016659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:20.077822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:20.086888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f31d4307-5b06-4213-b002-ba4f64d1a7e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084429 Aug 24 09:49:20.087464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 870/1727] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:20.306511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:20.307129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:20.313466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:20.313945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:20.314383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:20.315074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:20.315531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:20.315985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:20.509978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:20.518336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-735491d4-400a-47aa-bef7-9d3c2fcef32e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.215909 Aug 24 09:49:20.518912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 858/1728] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:20 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:21.108206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:21.108828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:21.115296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:21.115818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:21.116262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:21.116952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:21.117407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:21.117832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:21.177706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:21.185696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4758e301-e668-465f-959e-7d88682d4e1e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081408 Aug 24 09:49:21.186262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 871/1729] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:21.538854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:21.539463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:21.545788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:21.546266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:21.546695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:21.547376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:21.547863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:21.548285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:21.675394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:21.683977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e73d73d6-f870-4f8d-b3a3-abd55efae544 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148945 Aug 24 09:49:21.684541 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 859/1730] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:21 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:22.205663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:22.206258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:22.213361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:22.213843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:22.214278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:22.214961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:22.215412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:22.215870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:22.278210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:22.286930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1f52cbe0-e954-4291-b923-bcc0cdc41e11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085176 Aug 24 09:49:22.287494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 872/1731] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:22.705233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:22.705853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:22.713096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:22.713578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:22.714022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:22.714711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:22.715167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:22.715746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:22.844498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:22.852783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c72d6879-02a8-473d-96fd-e9318c056146 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151545 Aug 24 09:49:22.853347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 860/1732] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:22 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:23.307694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:23.308340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:23.314705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:23.315185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:23.315641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:23.316334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:23.316786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:23.317229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:23.377379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:23.385507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dd2e54ec-78f4-4042-88dd-b7f3f729de04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081725 Aug 24 09:49:23.386066 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 873/1733] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:23.873697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:23.874334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:23.881355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:23.881838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:23.882281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:23.882974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:23.883433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:23.883888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:24.008471 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:24.016585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ef767f12-d071-4a50-aa8e-13ed6b94f537 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146812 Aug 24 09:49:24.017146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 861/1734] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:23 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:24.406290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:24.406909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:24.413940 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:24.414428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:24.414868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:24.415561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:24.416052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:24.416483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:24.476818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:24.485104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2a0c2136-3f60-4fc2-b950-16aa5ff1e9fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082615 Aug 24 09:49:24.485707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 874/1735] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:25.037991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:25.038596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:25.045034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:25.045526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:25.045965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:25.046656 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:25.047112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:25.047540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:25.409460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:25.417648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-db0594da-c71e-4778-86fb-bdafe585220a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.383610 Aug 24 09:49:25.418214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 862/1736] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:25 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:25.505151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:25.505750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:25.512169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:25.512651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:25.513087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:25.513773 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:25.514224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:25.514648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:25.574329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:25.582430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-094773a1-7b89-4dcf-9cc6-ade4dc111c36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081175 Aug 24 09:49:25.582985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 875/1737] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:26.438627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:26.439149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:26.445585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:26.446058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:26.446490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:26.447170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:26.447647 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:26.448069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:26.571572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:26.579607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e87522e8-b43b-443b-b64e-7b6cae569f23 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.144930 Aug 24 09:49:26.580165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 863/1738] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:26 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:26.602694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:26.603309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:26.609692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:26.610167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:26.610601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:26.611284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:26.611775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:26.612196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:26.677310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:26.685415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1c5bdc43-b4f9-414a-b249-a3673ca36f0e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086530 Aug 24 09:49:26.685975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 876/1739] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:27.600448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:27.600975 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:27.607340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:27.607854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:27.608295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:27.608987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:27.609441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:27.609869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:27.706284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:27.707181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:27.713748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:27.714230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:27.714665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:27.715361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:27.715839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:27.716266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:27.740463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:27.749031 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f924700a-af14-4e6c-8d98-134481b79f71 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152510 Aug 24 09:49:27.749719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 864/1740] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:27 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:27.777901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:27.786507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0e8d597e-7871-47c9-9385-cadbb6976ce6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084339 Aug 24 09:49:27.787070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 877/1741] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:28.771132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:28.771759 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:28.777599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:28.778081 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:28.778517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:28.779206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:28.779690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:28.780124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:28.806672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:28.807323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:28.813779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:28.814281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:28.814714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:28.815408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:28.815887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:28.816312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:28.878795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:28.887918 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bc5af341-325d-467e-9ca6-26cab30344ec tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085142 Aug 24 09:49:28.888602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 878/1742] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:28.910191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:28.918170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8c0b429a-26e9-4cc5-92cd-1899b2cf4fd1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151782 Aug 24 09:49:28.918731 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 865/1743] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:28 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:29.908494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:29.909127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:29.915269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:29.915807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:29.916256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:29.916954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:29.917410 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:29.917840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:29.939320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:29.939967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:29.947316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:29.947845 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:29.948291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:29.948986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:29.949441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:29.949866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:29.979419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:29.987721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0786002e-2384-49e3-81c1-8ec94027e714 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083067 Aug 24 09:49:29.988298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 879/1744] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:30.079340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:30.087783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9507dcfa-184e-472d-b8c2-89f601714ac1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152380 Aug 24 09:49:30.088348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 866/1745] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:29 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:31.008877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:31.009691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:31.016067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:31.016544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:31.016977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:31.017670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:31.018121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:31.018550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:31.083186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:31.091877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e02b9b1f-81a8-446f-bb15-356198e13e42 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086995 Aug 24 09:49:31.092441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 880/1746] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:31.109418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:31.110028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:31.116899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:31.117383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:31.117825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:31.118516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:31.118973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:31.119400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:31.245208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:31.253362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e1b7a8dd-e927-455a-9d4e-99439fa86822 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147771 Aug 24 09:49:31.253936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 867/1747] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:31 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:32.112804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:32.113971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:32.120593 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:32.121071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:32.121504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:32.122189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:32.122641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:32.123178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:32.185300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:32.193959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0caa9f6a-509b-4292-9238-efcbdcce49bd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085023 Aug 24 09:49:32.194523 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 881/1748] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:32.273918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:32.274542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:32.280919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:32.281400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:32.281837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:32.282525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:32.282978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:32.283402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:32.414368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:32.423104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-244fec63-3110-43e1-9f54-46bfd737fd34 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152937 Aug 24 09:49:32.423763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 868/1749] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:32 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:33.214655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:33.215297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:33.222004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:33.222528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:33.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:33.223753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:33.224216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:33.224779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:33.301487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:33.309920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8f4cb75f-db6d-45b4-ae8b-a80f0a56faab tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.099056 Aug 24 09:49:33.310489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 882/1750] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:33.445183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:33.445862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:33.452645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:33.453125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:33.453563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:33.454396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:33.454847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:33.455467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:33.593136 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:33.601645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-09805400-ca8d-4ec7-b5da-39f518c67f3e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.160880 Aug 24 09:49:33.602214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 869/1751] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:33 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:34.330404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:34.330951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:34.338183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:34.338663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:34.339098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:34.339842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:34.340284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:34.340715 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:34.402223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:34.410770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fe83c1ea-5328-41e9-8e2f-96d4769e1fc7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083803 Aug 24 09:49:34.411340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 883/1752] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:34.622260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:34.622809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:34.629711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:34.630191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:34.630629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:34.631328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:34.631809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:34.632237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:34.759626 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:34.767655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-26bc64e0-8e25-4476-aed1-67dfcf246a80 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149297 Aug 24 09:49:34.768220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 870/1753] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:34 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:35.432175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:35.432793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:35.439174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:35.439687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:35.440128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:35.441815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:35.442274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:35.442700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:35.503323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:35.511507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8c2a64c4-cba5-4fef-be66-741c8b34a599 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083162 Aug 24 09:49:35.512095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 884/1754] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:35.789569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:35.790205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:35.796579 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:35.797052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:35.797479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:35.798159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:35.798609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:35.799030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:35.926057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:35.928633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:35.935175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-16f8706f-6417-4347-b248-5f3b853864f9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150064 Aug 24 09:49:35.935783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 871/1755] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:35 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:36.532250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:36.532857 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:36.535180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=56 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:36.539824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:36.540295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:36.540723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:36.541396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:36.541842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:36.542261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:36.603132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:36.611224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f152b3e4-5390-4d51-b4f7-9e8c105022df tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082850 Aug 24 09:49:36.611817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 885/1756] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:36.963765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:36.964456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:36.970854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:36.971327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:36.971806 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:36.973005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:36.973443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:36.973864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:37.103376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:37.111432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a2aa2eff-716b-49d2-939b-63979734f09f tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151907 Aug 24 09:49:37.112022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 872/1757] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:36 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:37.632803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:37.633361 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:37.639842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:37.640335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:37.640769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:37.641490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:37.641946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:37.642373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:37.657360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:37.705385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:37.714338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5dd9ddc7-bccc-448e-a5f6-3d67e7cff267 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086013 Aug 24 09:49:37.715128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 886/1758] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:38.132009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:38.132624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:38.134897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=52 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:38.139528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:38.140039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:38.140478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:38.141168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:38.141624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:38.142053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:38.271000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:38.282958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-15c768da-5b76-4d27-b249-d51a483373e5 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.154776 Aug 24 09:49:38.283530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 873/1759] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:38 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:38.734225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:38.734842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:38.741741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:38.742216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:38.742646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:38.743323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:38.743803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:38.744223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:38.804291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:38.812396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fadb7436-ee21-491b-90f8-8a6ea899f2ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082058 Aug 24 09:49:38.812952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 887/1760] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:39.304646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:39.305253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:39.311567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:39.312077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:39.312510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:39.313191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:39.313638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:39.314057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:39.438367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:39.446489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ed1a55d5-e876-4b37-aa7e-f4da775501c1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.146302 Aug 24 09:49:39.447045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 874/1761] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:39 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:39.834324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:39.834933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:39.841296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:39.841769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:39.842198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:39.842875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:39.843319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:39.843774 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:39.910992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:39.919630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-919d0029-6c6d-48ae-b14e-b108a8528afe tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.090099 Aug 24 09:49:39.920185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 888/1762] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:40.467755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:40.468382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:40.475405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:40.475919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:40.476357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:40.477049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:40.477508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:40.477935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:40.605363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:40.614050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-44951561-1749-412b-8e4f-48265c613fec tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149560 Aug 24 09:49:40.614623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 875/1763] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:40 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:40.940352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:40.940898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:40.947231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:40.947738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:40.948178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:40.948864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:40.949346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:40.949771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:41.013169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:41.021988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-39ed78a4-2d35-4b14-a9d2-4838b61cd281 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085570 Aug 24 09:49:41.022546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 889/1764] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:41.634945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:41.635512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:41.641870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:41.642349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:41.642776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:41.643454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:41.643932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:41.644367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:41.770818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:41.778868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fd753843-f410-4824-bda6-598b771d8c5e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147907 Aug 24 09:49:41.779426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 876/1765] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:41 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:42.042316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:42.042929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:42.049304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:42.049785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:42.050221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:42.051539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:42.052020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:42.052452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:42.115045 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:42.124674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-49b99e2c-a147-4c82-8ad1-eb5456d634fc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086161 Aug 24 09:49:42.125250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 890/1766] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:42.799415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:42.800059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:42.806461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:42.806948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:42.807388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:42.808103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:42.808562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:42.808985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:42.937461 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:42.946122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-df234f4d-e706-4482-9d39-255ae8fba332 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150587 Aug 24 09:49:42.946690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 877/1767] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:42 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:43.145170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:43.145709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:43.152349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:43.152833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:43.153266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:43.153953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:43.154409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:43.154835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:43.215175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:43.223237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0a027eb1-8c71-42bc-875d-f2836af0cb9e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082124 Aug 24 09:49:43.223832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 891/1768] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:43.966936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:43.967669 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:43.974564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:43.975036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:43.975467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:43.976174 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:43.976623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:43.977042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:44.106153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:44.114195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2e04a26a-a2fb-4a58-b26b-fac813136e2e tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151125 Aug 24 09:49:44.114751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 878/1769] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:43 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:44.243295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:44.243949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:44.250295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:44.250779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:44.251219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:44.251943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:44.252404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:44.252835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:44.313270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:44.321858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cb619c48-b614-48c2-88c3-cb3002ebb8e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082382 Aug 24 09:49:44.322409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 892/1770] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:45.135503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:45.136120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:45.142511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:45.142986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:45.143420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:45.144240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:45.145334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:45.145758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:45.271848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:45.280005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a960e705-3248-4fbd-aa61-8b679b0dbeae tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148317 Aug 24 09:49:45.280568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 879/1771] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:45 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:45.343006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:45.343639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:45.349970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:45.350444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:45.350875 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:45.351552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:45.352023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:45.352443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:45.412125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:45.420182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7efbc4a8-2c18-419e-bc71-6bcb523a64bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081028 Aug 24 09:49:45.420736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 893/1772] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:46.300966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:46.301593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:46.307985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:46.308469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:46.308910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:46.309601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:46.310058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:46.310484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:46.440935 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:46.441591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:46.442206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:46.448615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:46.449090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:46.449226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f88eae62-7ce5-4d78-b849-44de57ebd5d1 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.152141 Aug 24 09:49:46.449527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:46.456399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 880/1773] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:46 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:46.456591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:46.456591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:46.456591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:46.514927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:46.523568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c0cfff5f-f88a-435b-942f-2d9a1031d409 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086070 Aug 24 09:49:46.524141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 894/1774] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:47.470680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:47.471295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:47.477732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:47.478214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:47.478650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:47.479339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:47.479820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:47.480245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:47.544188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:47.544906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:47.552016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:47.552546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:47.553174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:47.554028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:47.554534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:47.554904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:47.609230 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:47.617991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-907177c7-603e-410d-8b6e-faecc8275f2a tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.151123 Aug 24 09:49:47.618149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:47.618560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 881/1775] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:47 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:47.626170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8e82ff99-125e-4850-a722-3ce7d1257980 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085949 Aug 24 09:49:47.626729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 895/1776] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:48.493098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:49:48.493646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:49:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:49:48.638374 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:48.638983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:48.645545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:48.646020 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:48.646159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:48.646618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:48.646733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:48.647121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:48.647920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:48.648351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:48.653002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:48.653483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:48.653919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:48.654616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:48.655070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:48.655493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:48.723872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:48.728247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-556e0b54-2e2d-46be-94d2-6ae1eb7f2e07 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085984 Aug 24 09:49:48.728812 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 896/1777] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:48.781971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:48.790869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2303eb70-208c-472e-8f6d-2d566785ac2d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.156340 Aug 24 09:49:48.791426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 882/1778] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:48 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:49.749614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:49.750309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:49.756608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:49.757083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:49.757521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:49.758243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:49.758648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:49.759068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:49.812392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:49.813024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:49.819689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:49.820181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:49.820625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:49.820756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:49.821322 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:49.821782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:49.822206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:49.829011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fd4000a3-5c94-4dbd-9b07-9f0c1bb6de1b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083315 Aug 24 09:49:49.829821 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 897/1779] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:49.948824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:49.957458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3d36095d-69b2-4fae-9d09-31dddff477a2 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148480 Aug 24 09:49:49.958017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 883/1780] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:49 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:50.850481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:50.851136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:50.857597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:50.858072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:50.858502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:50.859177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:50.859645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:50.860069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:50.936130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:50.945550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25ef4b51-36a6-44c1-9ce3-67fcecd4ff88 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.098617 Aug 24 09:49:50.946127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 898/1781] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:50.978638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:50.979247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:50.987715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:50.988849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:50.989287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:50.989976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:50.990426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:50.990846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:51.119545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:51.127897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8cec9e7f-bf0f-4fa3-b1bc-10dd7ad2ee69 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153066 Aug 24 09:49:51.136889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 884/1782] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:50 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:51.966355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:51.966952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:51.973388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:51.973862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:51.974297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:51.974977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:51.975690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:51.976124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:52.035990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:52.044060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-36e92915-ccb4-4cb3-ba82-b1412075e9a4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081532 Aug 24 09:49:52.044623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 899/1783] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:52.156368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:52.156991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:52.163416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:52.163941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:52.164381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:52.165072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:52.165530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:52.165963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:52.296899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:52.305758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-975f2994-6d28-4db4-8f31-b629fff602c9 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153326 Aug 24 09:49:52.306330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 885/1784] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:52 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:49:53.064268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:53.064865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:53.071938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:53.072411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:53.072842 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:53.073519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:53.073974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:53.074391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:53.134127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:53.142100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b8251eee-f2c1-4533-a713-870a0516b1dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081695 Aug 24 09:49:53.142658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 900/1785] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:53.326547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:53.327095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:53.333742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:53.334223 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:53.334659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:53.335350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:53.335841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:53.336268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:53.462021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:53.470316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9cb24348-9356-49be-bcda-95525a6c5b09 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.147735 Aug 24 09:49:53.470881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 886/1786] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:53 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:54.162850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:54.163464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:54.169839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:54.170320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:54.170755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:54.171441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:54.171929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:54.172356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:54.232985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:54.241567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8ad98844-b6a8-4271-8305-dbed965de062 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083124 Aug 24 09:49:54.242136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 901/1787] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:54.491137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:54.491713 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:54.498137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:54.498618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:54.499059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:54.499789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:54.500248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:54.500677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:54.629607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:54.637648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a847d54e-8bb9-478d-bbaf-c1d475ac4304 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.150499 Aug 24 09:49:54.638210 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 887/1788] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:54 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:55.262143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:55.262797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:55.268969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:55.269439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:55.269868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:55.270550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:55.270999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:55.271416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:55.337165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:55.345273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-34b2fdcf-763b-47fa-8a3e-17bbad285f7e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087082 Aug 24 09:49:55.345829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 902/1789] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:55.659070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:55.659716 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:55.666834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:55.667353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:55.667833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:55.668533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:55.668989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:55.669440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:55.684311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:55.795368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:55.804105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5b5fff97-8e3e-4da9-b4f4-a21a052def0d tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.148922 Aug 24 09:49:55.804667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 888/1790] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:55 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:56.365816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:56.366360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:56.372770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:56.373244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:56.373670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:56.374344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:56.374790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:56.375210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:56.377721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:49:56.436354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:56.444845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0dbe792f-7962-4a6a-be96-f9dcf13adf21 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082959 Aug 24 09:49:56.445400 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 903/1791] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:56.824584 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:56.825190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:56.831484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:56.832026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:56.832466 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:56.833411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:56.833871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:56.834298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:56.965504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:56.974160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-99ea1dce-abe8-40b8-bd5b-7739337f5b81 tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.153419 Aug 24 09:49:56.974733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 889/1792] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:56 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:57.466037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:57.466651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:57.473100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:57.473583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:57.474019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:57.474708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:57.475159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:57.475608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:57.536614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:57.544987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-53ab0fe7-8f10-465b-97c4-e9f088010797 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082754 Aug 24 09:49:57.547793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 904/1793] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:57.995598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:57.996209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] [instance: fca9f952-e8e8-425b-9f7b-cc3132ad26ce] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:58.002516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:58.002991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:58.003423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:58.004131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:58.004585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:58.005003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:58.132750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc3f904a4fc4abc91e8df52ec816a0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b3e1d0646174986919db290c6da2579', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:58.140816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ca9391ae-7724-4634-ae43-73bc21391f9b tempest-VolumesSnapshotTestJSON-1868448399 tempest-VolumesSnapshotTestJSON-1868448399-project] 10.222.0.16 "GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce" status: 200 len: 1560 microversion: 2.1 time: 0.149251 Aug 24 09:49:58.141376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 890/1794] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:57 2022] GET /compute/v2.1/servers/fca9f952-e8e8-425b-9f7b-cc3132ad26ce => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:58.565489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:58.566041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:58.572378 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:58.572890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:58.573328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:58.574285 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:58.574743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:58.575170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:58.634682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:58.642682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e4cae7be-f6df-4b12-96c9-afcfb03bfed1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081159 Aug 24 09:49:58.643253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 905/1795] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:49:59.663840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:49:59.664397 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:49:59.670336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:59.670814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:59.671245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:59.671950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:49:59.672404 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:49:59.672825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:49:59.743764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:49:59.744000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-aa119e33-782d-4d1c-940a-498657b7b49b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084593 Aug 24 09:49:59.744569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 891/1796] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:49:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:00.764598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:00.765143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:00.771824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:00.772308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:00.772751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:00.773446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:00.773902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:00.774331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:00.837342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:00.845486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-14b18f10-03a3-4b57-ab75-417ea16f4c16 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084821 Aug 24 09:50:00.846051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 906/1797] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:01.866473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:01.867079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:01.873801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:01.874278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:01.874708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:01.875390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:01.875869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:01.876291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:01.935823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:01.944350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-46a3cf15-0315-4c76-a48b-0fd9825bcfde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082248 Aug 24 09:50:01.944906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 892/1798] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:02.965101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:02.965693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:02.972081 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:02.972567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:02.973540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:02.974220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:02.974666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:02.975089 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:03.030778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:50:03.031312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:50:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:50:03.039834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:03.047984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-544fa01b-693e-4560-b9cc-e347b3321843 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086716 Aug 24 09:50:03.048603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 907/1799] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:04.069910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:04.070524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:04.076980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:04.077458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:04.077890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:04.078582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:04.079033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:04.079456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:04.144255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:04.152316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a7d45ceb-b0dc-41c8-bae2-83384179011e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086761 Aug 24 09:50:04.152866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 893/1800] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:05.172270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:05.172858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:05.179352 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:05.179852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:05.180288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:05.180968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:05.181418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:05.181837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:05.241815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:05.249757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d3e01a26-6d09-4252-bf66-4cc6d1f63e3a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081380 Aug 24 09:50:05.250317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 908/1801] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:06.270763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:06.271369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:06.277769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:06.278244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:06.278676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:06.279358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:06.279844 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:06.280267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:06.340715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:06.348878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fa8ae337-58ae-4c98-8be0-1a7bc202d107 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082498 Aug 24 09:50:06.349372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 894/1802] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:07.369863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:07.370477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:07.372878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=48 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:07.377696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:07.378177 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:07.378650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:07.379376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:07.380411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:07.380837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:07.444303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:07.452381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-411423b6-c039-4bc7-8e74-170961453330 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086428 Aug 24 09:50:07.452938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 909/1803] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:08.474099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:08.474665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:08.476947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=44 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:08.481564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:08.482045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:08.482483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:08.483167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:08.483641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:08.484070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:08.545242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:08.553953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7a87443d-615a-45b3-ae49-dc4d2c73b3d5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084368 Aug 24 09:50:08.554511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 895/1804] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:09.574339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:09.574906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:09.581267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:09.581747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:09.582694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:09.583657 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:09.584111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:09.584535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:09.793304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:09.801534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9a57f283-1ec8-4c0b-9bba-603af86aea6a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.231124 Aug 24 09:50:09.802095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 910/1805] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:10.822606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:10.823197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:10.829567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:10.830046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:10.830480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:10.831159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:10.831633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:10.832688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:10.893482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:10.901566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fa467b4e-01cb-4d66-a41d-6e1ac72bd9f1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082855 Aug 24 09:50:10.902125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 896/1806] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:11.921250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:11.921889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:11.929014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:11.929501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:11.929942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:11.930663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:11.931148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:11.931603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:11.993248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:12.001438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-39604ba7-268e-4d25-88ec-6ba27aec59ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084000 Aug 24 09:50:12.002000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 911/1807] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:13.022769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:13.023379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:13.029826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:13.030302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:13.030731 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:13.031412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:13.031895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:13.032316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:13.095309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:13.103401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f9d8495f-0677-4c36-b80b-0d921c95169e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085125 Aug 24 09:50:13.104024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 897/1808] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:14.124284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:14.124904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:14.131306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:14.131833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:14.132275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:14.132965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:14.133419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:14.133851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:14.194369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:14.202384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-72491611-bc14-4d3f-8ab1-ac52b8d15816 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081933 Aug 24 09:50:14.202938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 912/1809] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:15.224273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:15.224890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:15.231283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:15.231803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:15.232244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:15.232941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:15.233384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:15.233852 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:15.297214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:15.305995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-094c6b76-386f-4fda-848a-7048ea5df972 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086284 Aug 24 09:50:15.306557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 898/1810] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:16.326384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:16.326999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:16.333947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:16.334426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:16.334861 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:16.335551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:16.336030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:16.336461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:16.395749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:16.403762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-66b0fa18-0347-40b4-8792-4a386c6fafff tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081253 Aug 24 09:50:16.404320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 913/1811] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:17.424116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:17.424720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:17.432027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:17.434345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:17.434345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:17.434345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:17.434345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:17.434750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:17.495469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:17.503532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-48ed5e5d-f481-4f27-93c0-89e284af88e1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083301 Aug 24 09:50:17.504633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 899/1812] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:18.525272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:18.525908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:18.532243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:18.532724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:18.533235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:18.533924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:18.534376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:18.534802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:18.597349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:18.605856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ec250777-93ec-4d6e-b80a-46b8a71e7961 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084507 Aug 24 09:50:18.606428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 914/1813] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:19.628339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:19.629426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:19.635867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:19.636340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:19.636772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:19.637451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:19.637899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:19.638320 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:19.701124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:19.710153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7c101184-ae91-48a7-8505-da9bcc6dfd49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085775 Aug 24 09:50:19.710734 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 900/1814] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:20.730632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:20.731247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:20.737679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:20.738158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:20.738591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:20.739280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:20.740265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:20.740733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:20.802742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:20.810967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25886173-ad7d-45e7-9645-f0d5d9d5a75b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084292 Aug 24 09:50:20.811534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 915/1815] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:20.888887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:50:20.889144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:50:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:50:21.831956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:21.832565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:21.839813 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:21.840289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:21.840721 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:21.841403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:21.841851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:21.842268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:21.903146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:21.911229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0206a865-0f24-4376-943d-624c9a37a1e3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083148 Aug 24 09:50:21.911823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 901/1816] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:22.932308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:22.932872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:22.939266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:22.939799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:22.940233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:22.940922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:22.941373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:22.941800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:23.003734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:23.012412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-64e9a062-75f5-4e70-83c2-45f7a4925fc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084599 Aug 24 09:50:23.012974 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 916/1817] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:24.032052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:24.032689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:24.039259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:24.039788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:24.040217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:24.040908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:24.041363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:24.041787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:24.102611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:24.110490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e9f90a01-a3a8-4985-b72d-a89e5e542147 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082366 Aug 24 09:50:24.111047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 902/1818] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:25.131519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:25.132188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:25.138474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:25.138958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:25.139395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:25.140121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:25.140574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:25.140998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:25.200632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:25.208906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-26fbe091-4cff-45c2-b6fa-0cc7595e32ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081867 Aug 24 09:50:25.209453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 917/1819] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:26.230028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:26.230677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:26.237039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:26.237522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:26.237957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:26.238645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:26.239102 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:26.239528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:26.243998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=88 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:26.300863 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:26.309674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3bed271f-4f67-46c4-8b83-bd7c5f48ac33 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083756 Aug 24 09:50:26.310266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 903/1820] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:27.330279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:27.330928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:27.337655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:27.338135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:27.338564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:27.339293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:27.339769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:27.340196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:27.344072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=90 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:27.404136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:27.412273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c9170662-84b4-4e50-bdd8-16b9d36240f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086004 Aug 24 09:50:27.412840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 918/1821] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:28.432640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:28.433193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:28.440087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:28.440569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:28.441002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:28.441709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:28.442368 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:28.442934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:28.509746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:28.517819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-295699c3-86bb-4cd6-a278-2c94f6a6f651 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.089194 Aug 24 09:50:28.518377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 904/1822] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:29.538271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:29.538885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:29.545275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:29.545750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:29.546191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:29.546871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:29.547357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:29.547796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:29.608935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:29.617475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-54f89a91-89d4-4f01-a486-fe0757b03b27 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083091 Aug 24 09:50:29.618029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 919/1823] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:30.639033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:30.639772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:30.645840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:30.646325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:30.646763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:30.647452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:30.647933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:30.648364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:30.707392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:30.715779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7da97ede-be2f-4525-86b6-c21b856e60f6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.080762 Aug 24 09:50:30.716340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 905/1824] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:31.736436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:31.737018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:31.743806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:31.744320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:31.744758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:31.745448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:31.745926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:31.746335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:31.805722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:31.813767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25484a7d-3787-4291-847e-bc853c707884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081287 Aug 24 09:50:31.814327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 920/1825] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:32.835286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:32.835909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:32.842201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:32.842729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:32.843163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:32.843871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:32.844323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:32.844739 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:32.906631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:32.915057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-713a7324-d86b-49da-becf-f3c0943cfe2a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084548 Aug 24 09:50:32.915630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 906/1826] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:33.935696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:33.936318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:33.942738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:33.943759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:33.944248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:33.944939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:33.945394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:33.945821 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:34.007341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:34.015623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-73be6762-f4bf-41c7-83f7-ed30f1056cc0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083808 Aug 24 09:50:34.016187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 921/1827] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:35.035353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:35.035979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:35.043494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:35.044008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:35.044442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:35.045173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:35.045652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:35.046074 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:35.106602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:35.114776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-82e3eb8f-25b4-4030-b548-9e1892b991e5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083299 Aug 24 09:50:35.115327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 907/1828] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:36.135213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:36.135851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:36.142147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:36.142620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:36.143051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:36.143760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:36.144214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:36.144634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:36.209488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:36.217446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c8f5273d-bdb9-4804-9423-7594601c4b4b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086106 Aug 24 09:50:36.218000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 922/1829] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:37.237897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:37.238473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:37.245597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:37.246092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:37.246534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:37.247253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:37.247741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:37.248175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:37.312220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:37.321232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3a7ad3d0-763d-486e-aace-09feacfd5cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087294 Aug 24 09:50:37.321800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 908/1830] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:38.341179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:38.341799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:38.344212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=28 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:38.348913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:38.349404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:38.349841 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:38.350531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:38.350985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:38.351411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:38.411109 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:38.419156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8a71deb6-0ddb-4a32-8d5b-fc8b4a797a8e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081823 Aug 24 09:50:38.419740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 923/1831] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:39.439569 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:39.440330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:39.442591 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:39.448108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:39.448597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:39.449033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:39.449727 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:39.450181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:39.453606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:39.511773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:39.519857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-03129cc1-c3bb-4d6d-bb41-3ceccfd5bcfb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084181 Aug 24 09:50:39.520421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 909/1832] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:40.540129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:40.540750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:40.547071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:40.547548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:40.548016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:40.548707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:40.549189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:40.549618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:40.609723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:40.617864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ed5ba79c-74b6-4126-95c7-a090413d39d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081646 Aug 24 09:50:40.618418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 924/1833] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:41.638758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:41.639323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:41.645675 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:41.646146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:41.646578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:41.647802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:41.648253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:41.648674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:41.708236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:41.716828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2772094d-732a-4dcc-ad39-42d01d1d630d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082361 Aug 24 09:50:41.717382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 910/1834] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:42.737796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:42.738407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:42.745446 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:42.745929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:42.746367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:42.747065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:42.747531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:42.748010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:42.807892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:42.816094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f72368f3-9979-4c68-a874-f8d17cf43b9a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082146 Aug 24 09:50:42.816656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 925/1835] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:43.836918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:43.837531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:43.843937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:43.844421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:43.844857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:43.845550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:43.846004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:43.846429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:43.908402 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:43.916541 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9895453b-cca6-4444-a37f-17b236187a72 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083859 Aug 24 09:50:43.917135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 911/1836] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:44.937434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:44.938047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:44.944346 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:44.944821 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:44.945253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:44.945941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:44.946526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:44.946957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:45.010142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:45.018308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0aba22de-bcce-45f6-a596-0e613679fc17 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084731 Aug 24 09:50:45.018863 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 926/1837] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:46.038294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:46.038904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:46.045412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:46.045893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:46.046330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:46.047057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:46.047543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:46.047996 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:46.111292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:46.120018 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-96cf192b-cc04-4ff1-a024-c3be14be5880 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085587 Aug 24 09:50:46.120575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 912/1838] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:47.141154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:47.141775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:47.148808 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:47.149283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:47.149716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:47.150396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:47.150844 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:47.151265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:47.211810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:47.219994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fa8376cf-eaf4-4574-a793-e5a54685fbd8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082720 Aug 24 09:50:47.220541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 927/1839] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:48.240470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:48.241573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:48.247953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:48.248430 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:48.248860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:48.249541 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:48.249991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:48.250418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:48.310540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:48.318725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3b272d51-cb6c-4da7-a712-07d65fc3297d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082108 Aug 24 09:50:48.319847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 913/1840] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:49.339832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:49.340457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:49.346896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:49.347379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:49.347845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:49.348542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:49.349004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:49.349430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:49.409238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:49.417854 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-115b649e-7c4d-45d5-9c8c-0955d142fcd4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081929 Aug 24 09:50:49.418409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 928/1841] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:50.438974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:50.439513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:50.445909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:50.446382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:50.446810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:50.447486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:50.447959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:50.448378 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:50.510948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:50.517045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f0f0f716-a6c9-4358-8988-d31bfbaf78d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082177 Aug 24 09:50:50.517605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 914/1842] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:51.537993 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:51.538617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:51.545025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:51.545506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:51.545945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:51.546636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:51.547089 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:51.547516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:51.609757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:51.618266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-74ce2c62-1f82-49c5-adf0-8554bd703f6f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084163 Aug 24 09:50:51.618829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 929/1843] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:52.638856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:52.648907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:52.648907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:52.648907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:52.648907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:52.649362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:52.649362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:52.649362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:52.710036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:52.718096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-428082e6-6990-4d9d-b048-fed120e31e99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083102 Aug 24 09:50:52.718661 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 915/1844] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:53.738309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:53.738876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:53.745755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:53.746239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:53.746677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:53.747370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:53.747846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:53.748276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:53.811772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:53.820497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c8156533-05b5-4dbb-9cc2-8e7d3affa4d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086118 Aug 24 09:50:53.821054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 930/1845] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:54.841075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:54.841671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:54.848087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:54.848560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:54.848995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:54.849688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:54.850146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:54.850567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:54.913872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:54.922104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7edfc21d-aca7-4fb3-a2ed-0513e640f3e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084856 Aug 24 09:50:54.922792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 916/1846] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:55.949943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:55.950563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:55.957007 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:55.957494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:55.958202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:55.958905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:55.959888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:55.960323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:56.019375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:56.028006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-006a9bbf-eba1-42c1-a7b2-2a68ef45dd04 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081945 Aug 24 09:50:56.028571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 931/1847] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:57.049039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:57.050351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:57.057525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:57.058006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:57.058442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:57.059129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:57.059604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:57.060026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:57.062509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=84 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:57.123057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:57.131035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-359e3a4d-7a83-44ea-b248-e30a6e81f8fb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085781 Aug 24 09:50:57.131612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 917/1848] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:58.152090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:58.152698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:58.158977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:58.159451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:58.159910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:58.160592 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:58.161040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:58.161461 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:58.165907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=84 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:50:58.221468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:58.230133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2f006a8c-9306-4f1b-8a37-0b4dd9dc9f4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081954 Aug 24 09:50:58.230693 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 932/1849] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:50:59.250667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:50:59.251308 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:50:59.257439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:59.257922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:59.258366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:59.259087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:50:59.259548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:50:59.260007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:50:59.320768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:50:59.329118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b6c13ed4-62a1-45cf-9555-b3add4bd6eb7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082468 Aug 24 09:50:59.329689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 918/1850] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:50:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:00.349340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:00.350674 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:00.356889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:00.357373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:00.357805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:00.358493 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:00.358943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:00.359368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:00.418732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:00.426893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-409fe5f4-f50d-44fe-a8d7-ab7e81146456 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081396 Aug 24 09:51:00.427444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 933/1851] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:01.447678 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:01.448316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:01.454695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:01.455108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:01.455541 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:01.456246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:01.456696 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:01.457118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:01.519022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:01.527856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5c6c00cd-9e49-415f-9df3-1e5bff3e5d96 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084689 Aug 24 09:51:01.528406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 919/1852] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:01 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:02.548309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:02.548927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:02.556510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:02.556998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:02.557440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:02.558141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:02.558605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:02.559039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:02.622079 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:02.630230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7b47ce6e-4eb1-4464-adf0-4c5a27f8882a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085827 Aug 24 09:51:02.637088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 934/1853] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:03.658463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:03.659072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:03.665417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:03.665893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:03.666321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:03.667005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:03.667451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:03.667898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:03.731373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:03.739392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1a73e03c-a32b-4b8e-8f7a-056bb8a17117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084906 Aug 24 09:51:03.740080 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 920/1854] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:04.759878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:04.760524 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:04.766834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:04.767313 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:04.767797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:04.768489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:04.768947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:04.769368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:04.829242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:04.838271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a57600a2-6442-481f-97be-fe36d1787290 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082250 Aug 24 09:51:04.838933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 935/1855] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:05.860224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:05.860866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:05.867201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:05.867717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:05.868150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:05.868827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:05.869275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:05.869694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:05.929612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:05.937633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0c4f99d9-ec13-4cde-87bb-786f9ff9241a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081284 Aug 24 09:51:05.938184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 921/1856] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:06.959127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:06.959777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:06.966143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:06.966632 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:06.967069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:06.967787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:06.968244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:06.968671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:07.029952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:07.038865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a9644502-7fee-4c27-8024-a700d6fbf0f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084381 Aug 24 09:51:07.039426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 936/1857] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:08.059246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:08.059900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:08.066367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:08.066851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:08.067289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:08.068016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:08.068469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:08.068895 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:08.128668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:08.137542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7088cfc4-6c25-41cf-9960-ae0e162b4056 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082231 Aug 24 09:51:08.138097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 922/1858] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:09.158332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:09.158944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:09.161208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=28 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:09.166379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:09.166855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:09.167290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:09.168073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:09.168527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:09.168967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:09.230699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:09.238774 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5d936bea-7aef-4553-8d0e-13fd14e7d158 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084388 Aug 24 09:51:09.239334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 937/1859] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:10.259392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:10.259986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:10.262270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:10.266826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:10.267302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:10.267773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:10.268460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:10.268945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:10.269367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:10.332408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:10.340860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-31a87ad4-4756-4efe-948e-ff7058d7f749 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086040 Aug 24 09:51:10.341424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 923/1860] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:11.361886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:11.362596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:11.369685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:11.374158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:11.374158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:11.374158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:11.374158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:11.374582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:11.435370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:11.443650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6e53f47e-62ae-44a4-b286-c9a698e5c575 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085671 Aug 24 09:51:11.444209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 938/1861] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:12.464577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:12.465160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:12.471452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:12.471958 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:12.472389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:12.473099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:12.473546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:12.473972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:12.538244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:12.546445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-606808a5-ffc5-46de-9834-97ab1ecfc4bb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085938 Aug 24 09:51:12.547005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 924/1862] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:12 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:13.568802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:13.569447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:13.575778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:13.576260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:13.576700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:13.577391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:13.577848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:13.578275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:13.638180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:13.646825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a7149d14-f137-4d06-949d-72abdf25ff45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082467 Aug 24 09:51:13.647390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 939/1863] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:14.668948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:14.669500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:14.675880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:14.676363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:14.676802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:14.677492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:14.677947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:14.678379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:14.742181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:14.750337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-222bc956-72e6-45e5-a0f9-fc0ef585c884 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085368 Aug 24 09:51:14.750898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 925/1864] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:15.770425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:15.772301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:15.779233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:15.779966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:15.780578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:15.781443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:15.782059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:15.782648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:15.845471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:15.854130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-74ad3262-d387-49ae-ba84-6a37ee0c810e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087705 Aug 24 09:51:15.854727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 940/1865] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:16.875477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:16.876121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:16.882426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:16.882952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:16.883609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:16.884715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:16.884828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:16.885156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:16.946247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:16.954628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f4a8e169-ad80-4066-a165-b9b26c9b6a56 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083059 Aug 24 09:51:16.955189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 926/1866] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:17.975942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:17.976567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:17.982983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:17.983474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:17.983952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:17.984642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:17.985107 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:17.985536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:18.046252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:18.055017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1d567404-2bf3-4143-b9a0-e495576348e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083111 Aug 24 09:51:18.055587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 941/1867] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:19.074578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:19.075175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:19.081708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:19.082189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:19.082635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:19.083617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:19.084567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:19.084993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:19.144244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:19.152874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a50c1655-cb07-4736-866a-95494c043431 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082224 Aug 24 09:51:19.153433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 927/1868] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:20.173553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:20.174165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:20.181412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:20.181884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:20.182314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:20.182998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:20.183443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:20.183900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:20.249120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:20.257369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fe1c4809-5d62-4585-b333-84b19fc65c83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087754 Aug 24 09:51:20.258037 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 942/1869] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:21.277529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:21.278156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:21.284706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:21.285184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:21.285618 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:21.286309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:21.286763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:21.287188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:21.351571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:21.359841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f83d8340-b107-42e4-ae48-5e3535c2d818 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086122 Aug 24 09:51:21.360406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 928/1870] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:21.468607 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:51:21.469153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:51:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:51:22.379552 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:22.380206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:22.387548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:22.388012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:22.388454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:22.389150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:22.389605 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:22.390038 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:22.451186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:22.460637 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-542b7bc9-5e01-4bda-a967-1511cf6574e4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084971 Aug 24 09:51:22.461188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 943/1871] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:23.481639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:23.493817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:23.493817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:23.493817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:23.493817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:23.494274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:23.494274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:23.494274 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:23.552815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:23.560889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b5198b88-8486-4af2-88d6-b7f0f70dd5eb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083193 Aug 24 09:51:23.561454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 929/1872] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:23 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:51:24.581453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:24.582001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:24.588610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:24.589093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:24.589532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:24.590224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:24.590678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:24.591116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:24.650711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:24.658761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-86ffa07a-ac64-4ae7-99e3-90300950822b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081277 Aug 24 09:51:24.659317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 944/1873] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:25.679892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:25.680479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:25.686781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:25.687257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:25.687719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:25.688398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:25.688851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:25.689271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:25.751914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:25.760757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ed824268-eea6-447a-83ce-4c4a5413a6f3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084965 Aug 24 09:51:25.761315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 930/1874] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:26.781108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:26.781704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:26.788680 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:26.789155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:26.789590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:26.790273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:26.790721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:26.791143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:26.852073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:26.860364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-91d9cd4e-9c4e-48ba-9027-07b994a389ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083148 Aug 24 09:51:26.865550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 945/1875] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:27.882295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:27.882908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:27.889508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:27.889988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:27.890423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:27.891110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:27.891562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:27.892005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:27.894512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=84 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:27.956860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:27.966185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-36592c59-0f10-4400-bca6-08782532dc57 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.088446 Aug 24 09:51:27.966746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 931/1876] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:28.986901 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:28.987509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:28.994516 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:28.994997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:28.995432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:28.996151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:28.996602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:28.997023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:29.000924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=84 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:29.060369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:29.069200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a911dce8-e4b3-4367-9d23-c92e678d7d36 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086336 Aug 24 09:51:29.069746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 946/1877] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:30.090701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:30.091751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:30.098327 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:30.098805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:30.099278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:30.100011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:30.100468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:30.100892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:30.160511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:30.168660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8f815128-32a9-4f05-b2e9-3565de45f74f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082536 Aug 24 09:51:30.169214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 932/1878] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:30.967941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:51:30.968536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:51:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:51:31.188981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:31.189598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:31.196283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:31.196766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:31.197204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:31.197893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:31.198344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:31.198771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:31.260106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:31.268705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8c97f7cb-6df2-4afa-9cb3-72f2726453d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083568 Aug 24 09:51:31.269272 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 947/1879] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:32.289549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:32.290178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:32.296537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:32.297026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:32.297500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:32.298242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:32.298853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:32.299284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:32.360867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:32.369183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b4266e8c-c922-416f-800b-017c9497210f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083636 Aug 24 09:51:32.369748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 933/1880] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:32 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:33.390229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:33.390837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:33.397794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:33.398270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:33.398701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:33.399392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:33.399896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:33.400321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:33.462401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:33.470379 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-229c36dc-009f-4592-ab1d-f9378b95c3b9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083985 Aug 24 09:51:33.470926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 948/1881] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:34.491730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:34.492273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:34.498666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:34.499152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:34.499619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:34.500311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:34.500767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:34.501195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:34.560851 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:34.568973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ba92654b-a845-4254-b256-290d7280c8dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081774 Aug 24 09:51:34.569535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 934/1882] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:35.590144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:35.590679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:35.597167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:35.597638 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:35.598068 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:35.598748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:35.599228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:35.599676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:35.660807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:35.669209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-61361594-3fa0-4143-b955-77fe18ee974f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083470 Aug 24 09:51:35.669845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 949/1883] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:36.690240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:36.690881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:36.697875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:36.698355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:36.698792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:36.699482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:36.699965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:36.700394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:36.763056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:36.771847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c77ad061-053b-44e9-ba49-3b6717146805 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085448 Aug 24 09:51:36.772413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 935/1884] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:37.792780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:37.793389 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:37.800001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:37.800479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:37.800915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:37.802381 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:37.802847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:37.803304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:37.866342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:37.874426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b0ecaa8b-975f-48f5-8caf-f61e5c6378c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085562 Aug 24 09:51:37.874977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 950/1885] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:38.895493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:38.896708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:38.902988 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:38.903469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:38.904064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:38.904742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:38.905197 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:38.905648 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:38.966294 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:38.974415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-346e8415-677d-46eb-8fb4-ba35f7987ae6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082810 Aug 24 09:51:38.974981 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 936/1886] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:39.997191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:39.997809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:40.000084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=28 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:40.004733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:40.005876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:40.006298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:40.006994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:40.007448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:40.007913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:40.068683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:40.076611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6b40553d-7d90-415b-8db0-6c7cfeec19ed tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083348 Aug 24 09:51:40.077164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 951/1887] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:41.097328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:41.097939 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:41.100882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:41.105512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:41.105998 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:41.106434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:41.107127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:41.107594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:41.108027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:41.170109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:41.178927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a3226678-12d4-4bad-940b-8c42b5375851 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085536 Aug 24 09:51:41.179493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 937/1888] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:42.199328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:42.199976 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:42.206307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:42.206789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:42.207226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:42.208734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:42.209192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:42.209618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:42.268744 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:42.277397 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1ba7655e-fd0c-456e-a0d7-d21c4384639f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081946 Aug 24 09:51:42.277957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 952/1889] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:42 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:43.298548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:43.299178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:43.305655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:43.306138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:43.306575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:43.307269 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:43.307758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:43.308195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:43.368903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:43.378690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3c950de4-57d6-4dc3-b422-557c182e8e3e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083940 Aug 24 09:51:43.379444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 938/1890] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:44.402739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:44.403296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:44.409809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:44.410295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:44.410733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:44.411427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:44.411913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:44.412345 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:44.473213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:44.481417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9ee71b24-3334-4c43-a629-1d42c28a10bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082722 Aug 24 09:51:44.481972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 953/1891] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:45.501900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:45.502506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:45.509486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:45.509963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:45.510392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:45.511071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:45.511525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:45.511968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:45.575086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:45.583499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-471eee1f-a1a2-40d8-a004-f680831a5841 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085413 Aug 24 09:51:45.584108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 939/1892] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:46.604276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:46.604893 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:46.611276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:46.611794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:46.612230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:46.612908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:46.613358 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:46.613776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:46.676788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:46.685180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e732e0ed-0942-4d40-8def-679d0adcc7e8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084760 Aug 24 09:51:46.685735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 954/1893] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:47.705709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:47.706296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:47.713347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:47.713828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:47.714262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:47.714940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:47.715390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:47.715831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:47.775929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:47.784065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bac55fd0-5705-49bf-8b8f-33aa6418e8cd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082297 Aug 24 09:51:47.784631 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 940/1894] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:48.805633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:48.806366 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:48.812754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:48.813235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:48.813672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:48.814406 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:48.814862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:48.815292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:48.877519 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:48.885736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-70e6398b-443a-4fa1-aaf5-bb9e875f1939 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084661 Aug 24 09:51:48.886291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 955/1895] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:49.906289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:49.906910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:49.914421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:49.914904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:49.915343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:49.916063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:49.916516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:49.916989 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:49.977467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:49.985571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e7a3e601-16f5-4b2e-95a2-904b6eb90838 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083197 Aug 24 09:51:49.986124 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 941/1896] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:51.006320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:51.006951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:51.013233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:51.013703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:51.014130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:51.014811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:51.015261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:51.015716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:51.079530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:51.088899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bd39e97f-e9a0-48d4-90f0-233379495a75 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086453 Aug 24 09:51:51.089463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 956/1897] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:52.109290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:52.109980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:52.116509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:52.116997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:52.117441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:52.118134 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:52.118593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:52.119024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:52.179566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:52.187784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cac30b88-281c-44ee-9e1e-729dd74d3a37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082324 Aug 24 09:51:52.188350 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 942/1898] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:52 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:53.207296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:53.208192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:53.214489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:53.214969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:53.215403 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:53.216132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:53.216585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:53.217010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:53.276890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:53.284919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e1158d3c-d352-4c4b-981e-d12ec0a2c92a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081500 Aug 24 09:51:53.285483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 957/1899] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:54.306114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:54.306741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:54.313142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:54.313622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:54.314058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:54.314769 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:54.315226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:54.315681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:54.380978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:54.389317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f3025963-1f7f-491d-b8ac-a88857d11de5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.087036 Aug 24 09:51:54.389877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 943/1900] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:55.410073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:55.411174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:55.417652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:55.418132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:55.418567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:55.419273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:55.419737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:55.420171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:55.482814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:55.491465 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-06fc87e6-b48c-4407-af28-1b1c22e8c6e9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085300 Aug 24 09:51:55.492046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 958/1901] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:56.511953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:56.512524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:56.518993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:56.519475 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:56.520093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:56.520812 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:56.521267 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:56.521688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:56.583809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:56.591911 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4624793f-1049-4842-8ec4-8c0b2359111f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083905 Aug 24 09:51:56.592479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 944/1902] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:57.612602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:57.613152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:57.619538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:57.620049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:57.620487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:57.621210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:57.621661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:57.622087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:57.681404 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:57.689421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c22be903-eb1b-4222-955b-3a6a24ad2ee7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.080780 Aug 24 09:51:57.689972 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 959/1903] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:51:58.711875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:58.712479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:58.718586 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:58.719137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:58.719719 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:58.720411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:58.720869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:58.721295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:58.784796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:58.792918 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-569374ba-1ad6-4042-8370-9e70ea1886f8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086026 Aug 24 09:51:58.793473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 945/1904] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:51:59.813986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:51:59.814609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:51:59.821332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:59.821835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:59.822261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:59.822953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:51:59.823411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:51:59.823868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:51:59.826396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=84 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:51:59.886190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:51:59.894602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-77fcfd60-b296-4357-9f43-6f9409911d37 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084556 Aug 24 09:51:59.895166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 960/1905] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:51:59 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:00.915025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:00.915649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:00.921950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:00.922401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:00.922830 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:00.923517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:00.923995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:00.924418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:00.926937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=90 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:00.985459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:00.994313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a333d201-c0b3-41df-b4c0-95ff880b83e6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083036 Aug 24 09:52:00.994897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 946/1906] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:00 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:02.015948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:02.016562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:02.022988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:02.023544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:02.024012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:02.024706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:02.025184 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:02.025616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:02.087939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:02.096427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-83d27e64-853b-437e-a984-01aed50c7191 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084425 Aug 24 09:52:02.096975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 961/1907] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:02 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:03.116962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:03.117582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:03.124112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:03.124537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:03.125005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:03.125691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:03.126146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:03.126570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:03.189417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:03.198115 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8715ca60-89fe-40c7-a1a1-4cbfac82026c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085091 Aug 24 09:52:03.198679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 947/1908] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:03 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:04.219409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:04.220046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:04.226935 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:04.227412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:04.227882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:04.228562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:04.229008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:04.229431 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:04.291234 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:04.299423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-de39bb7d-9f98-4ee2-9f35-412fdc92fa82 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083874 Aug 24 09:52:04.300012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 962/1909] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:04 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:05.320284 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:05.320896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:05.327281 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:05.327798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:05.328233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:05.328917 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:05.329367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:05.329787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:05.390113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:05.398930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f153b5ed-484f-4791-a736-d8041879e4c3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083121 Aug 24 09:52:05.399481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 948/1910] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:05 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:06.419705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:06.420439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:06.427364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:06.427886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:06.428326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:06.429016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:06.429469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:06.429895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:06.490145 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:06.498185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-167c82d3-193c-4892-bd8a-f9bfcbd72760 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083026 Aug 24 09:52:06.498747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 963/1911] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:06 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:07.519335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:07.519977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:07.526305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:07.526781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:07.527213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:07.527928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:07.528384 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:07.528801 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:07.589318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:07.597937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-650e10e7-0739-4cb2-8712-9d44dab82117 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081970 Aug 24 09:52:07.598486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 949/1912] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:07 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:08.618779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:08.619395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:08.625838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:08.626321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:08.626756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:08.627452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:08.627931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:08.628357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:08.689951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:08.698777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6fe4d7fa-1f2e-4263-b88c-c20a0b9aaafb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083852 Aug 24 09:52:08.699333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 964/1913] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:08 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:09.719819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:09.720385 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:09.726616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:09.727092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:09.727529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:09.728238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:09.728683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:09.729103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:09.788737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:09.796728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-07310c6f-bb6d-43c5-b09a-d674169cc216 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.080893 Aug 24 09:52:09.797280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 950/1914] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:09 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:10.817671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:10.818316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:10.820606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=28 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:10.825362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:10.825843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:10.826278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:10.826968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:10.827423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:10.827879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:10.888653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:10.896815 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0511c895-952e-4334-a3f1-a6d93fbe66dc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083597 Aug 24 09:52:10.897367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 965/1915] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:10 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:11.917161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:11.918610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:11.920932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:11.926290 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:11.926811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:11.927247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:11.927966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:11.932072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:11.932072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:11.994568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:12.002582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-282a4b6f-b7f5-4f5d-8df1-8356cedb794e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.089323 Aug 24 09:52:12.003140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 951/1916] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:11 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:13.023464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:13.024093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:13.030618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:13.031100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:13.031534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:13.032251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:13.032701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:13.033123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:13.096386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:13.105003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4b6d5553-2414-4130-8f5b-bc89e1cb8297 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085495 Aug 24 09:52:13.105556 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 966/1917] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:13 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:14.125803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:14.126418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:14.133357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:14.133832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:14.134263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:14.134949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:14.135398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:14.135855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:14.199361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:14.207825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-76e1ad85-033f-4343-8667-80600298be5e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085692 Aug 24 09:52:14.208468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 952/1918] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:14 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:15.229277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:15.229823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:15.236218 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:15.236700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:15.237140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:15.237829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:15.238284 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:15.238710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:15.299125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:15.307449 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5aaaaae0-1ecb-4344-91d6-83cead90a4c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082205 Aug 24 09:52:15.308041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 967/1919] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:15 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:16.334834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:16.335436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:16.341875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:16.342357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:16.342795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:16.343491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:16.343977 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:16.344409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:16.411671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:16.419839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fa6d3c9a-6908-4701-9bab-63394d3f349c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.089810 Aug 24 09:52:16.420409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 953/1920] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:16 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:17.440919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:17.441477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:17.448015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:17.448500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:17.448942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:17.449633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:17.450088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:17.450532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:17.512648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:17.521193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6b6beade-06ab-4b1f-8dbc-60942282cd2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084258 Aug 24 09:52:17.521747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 968/1921] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:17 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:18.540756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:18.541380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:18.547742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:18.548226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:18.548662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:18.549347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:18.549804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:18.550745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:18.610488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:18.619217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ead20a3e-88b0-4ef9-9dc4-6059d30a4469 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082299 Aug 24 09:52:18.619816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 954/1922] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:18 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:52:19.639167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:19.639727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:19.646071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:19.646550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:19.646986 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:19.647710 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:19.648192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:19.648617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:19.708900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:19.716917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-03891fe3-4de2-4b0d-b41f-a670134863d6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081736 Aug 24 09:52:19.717479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 969/1923] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:19 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:20.739008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:20.739649 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:20.746064 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:20.746546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:20.746985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:20.747703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:20.748164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:20.748590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:20.811414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:20.820076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9acd975d-59e7-4328-9f1b-5b8e2749b79f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085527 Aug 24 09:52:20.820635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 955/1924] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:20 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:21.840588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:21.841243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:21.848160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:21.848642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:21.849082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:21.849769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:21.850226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:21.850651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:21.912649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:21.920764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7fe64b78-da76-4311-b1c4-707dfac205d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084060 Aug 24 09:52:21.921353 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 970/1925] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:21 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:22.941595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:22.942213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:22.948577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:22.949059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:22.949498 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:22.950190 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:22.950646 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:22.951072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:23.232078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:23.240156 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-11dc0768-0c86-4f77-98f4-6f3c80ce5038 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.302411 Aug 24 09:52:23.240725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 956/1926] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:22 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:24.260661 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:24.261273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:24.267718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:24.268194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:24.268633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:24.269309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:24.269757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:24.270175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:24.329763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:24.338289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-71f2bf47-e86e-4d49-ad51-7861ff1d8ac3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081560 Aug 24 09:52:24.338849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 971/1927] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:24 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:25.358593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:25.359203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:25.365797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:25.366270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:25.366701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:25.367381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:25.367853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:25.368272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:25.432549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:25.440828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e00e6c3-98ac-4da2-9e00-29edfa2cdf99 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.086085 Aug 24 09:52:25.441400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 957/1928] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:25 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:26.461699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:26.462259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:26.468631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:26.469110 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:26.469548 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:26.470268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:26.470721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:26.471148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:26.531331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:26.540187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e1fa5a30-2a1a-4cc0-9545-81062d6f6e0f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082715 Aug 24 09:52:26.540747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 972/1929] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:26 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:27.561130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:27.561709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:27.568761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:27.569244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:27.569683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:27.570372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:27.570828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:27.571255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:27.634763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:27.642843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e91d314-4152-4e04-964d-650a6dd2b26a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085661 Aug 24 09:52:27.643408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 958/1930] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:27 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:28.663213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:28.663846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:28.670228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:28.670707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:28.671138 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:28.671846 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:28.672301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:28.672722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:28.733154 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:28.741806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fd3b7770-c77d-4b24-ab04-061238ad676a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082462 Aug 24 09:52:28.742367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 973/1931] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:28 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:29.763002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:29.763552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:29.769641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:29.770154 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:29.770593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:29.771285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:29.771770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:29.772196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:29.831528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:29.840072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-879f59ba-1924-4553-ae78-ea8c08fa1f40 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.080957 Aug 24 09:52:29.840639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 959/1932] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:29 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:30.863092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:30.864388 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:30.870470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:30.870946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:30.871377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:30.872095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:30.872555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:30.872979 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:30.875466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=84 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:30.939063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:30.947934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bb6260de-d293-464c-bf79-51ba9a2f8386 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.088656 Aug 24 09:52:30.948503 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 974/1933] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:30 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:31.969896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:31.970506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:31.976877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:31.977360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:31.977794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:31.978484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:31.978941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:31.979367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:31.981905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=84 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:32.041183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:32.049314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4f529265-0c77-427d-bffa-cfb0f8db89c4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083318 Aug 24 09:52:32.049870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 960/1934] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:31 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:33.070758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:33.071369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:33.077777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:33.078252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:33.078687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:33.079363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:33.079836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:33.080256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:33.140682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:33.149467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-102a43e1-f08e-499e-82d1-2342de77d1a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083175 Aug 24 09:52:33.150011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 975/1935] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:33 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:34.170675 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:34.170675 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:34.177573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:34.178053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:34.178488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:34.179173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:34.179659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:34.180086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:34.240218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:34.248311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8d68cd6a-be94-4281-91bc-95a1f8dd9e90 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082206 Aug 24 09:52:34.248867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 961/1936] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:34 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:35.268898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:35.269505 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:35.275825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:35.276307 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:35.276746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:35.277445 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:35.277919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:35.278327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:35.340215 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:35.348396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b658623f-0197-463f-b2aa-91a4030d9d85 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083445 Aug 24 09:52:35.348953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 976/1937] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:35 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:36.368634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:36.369250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:36.375741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:36.376222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:36.376660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:36.377348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:36.377802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:36.378227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:36.441017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:36.449129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6ed0ec92-98de-408b-af3c-3d58f54474ae tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084411 Aug 24 09:52:36.449699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 962/1938] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:36 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:37.470105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:37.470739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:37.477576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:37.478056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:37.478492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:37.479178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:37.479682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:37.480112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:37.541585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:37.549721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9a485a76-dde0-4f2a-a9e5-cff688225e97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083516 Aug 24 09:52:37.550279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 977/1939] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:37 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:38.570282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:38.570904 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:38.577298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:38.577781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:38.578222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:38.578913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:38.579366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:38.579819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:38.639909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:38.647923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a318809d-4fa8-4fd9-be5c-2c88e8ff897c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082084 Aug 24 09:52:38.648486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 963/1940] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:39.667651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:39.668210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:39.674567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:39.675044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:39.675507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:39.676250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:39.676700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:39.677125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:39.739704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:39.747872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0bc30c49-eb37-4681-ac03-287a2d4d9cdf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084157 Aug 24 09:52:39.748459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 978/1941] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:39 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:40.768707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:40.769356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:40.776414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:40.776899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:40.777335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:40.778029 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:40.778483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:40.778909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:40.841241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:40.849908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4e807de8-a6a5-4910-83fc-3c7747566307 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.085069 Aug 24 09:52:40.850480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 964/1942] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:40 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:41.870342 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:41.870957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:41.873265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=28 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:41.877905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:41.882827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:41.882827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:41.882827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:41.882827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:41.883251 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:42.153533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:42.161728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-aca0e91e-7acb-4904-a764-8357f0058852 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.295236 Aug 24 09:52:42.162288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 979/1943] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:41 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:43.182312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:43.182913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:43.185212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=28 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:52:43.189840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:43.190321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:43.190758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:43.191445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:43.191924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:43.198184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:43.253211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:43.261287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-00dc7e6e-8c31-4853-a550-85a12f0460b1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082890 Aug 24 09:52:43.261847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 965/1944] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:43 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:44.282125 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:44.282739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:44.289158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:44.289644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:44.290078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:44.290772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:44.291225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:44.291682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:44.351462 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:44.359623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-59f49f21-e435-4efe-9008-57806dc8411e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081364 Aug 24 09:52:44.360187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 980/1945] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:44 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:45.380534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:45.381138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:45.387473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:45.387976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:45.388407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:45.389086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:45.389583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:45.390005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:45.452470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:45.460772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a1574869-ec01-463b-b57f-6b9b9583d12c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084770 Aug 24 09:52:45.461337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 966/1946] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:45 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:46.481317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:46.481862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:46.488270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:46.488751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:46.489185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:46.489876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:46.490330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:46.490758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:46.553941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:46.561998 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3b8dcf48-0497-4a5b-9a80-42cc5381fdde tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084735 Aug 24 09:52:46.562559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 981/1947] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:46 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:47.584647 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:47.585206 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:47.591692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:47.592176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:47.592613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:47.593300 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:47.593764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:47.594178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:47.654502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:47.662641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7a7e40f8-6212-407d-8892-fbfd7dc534f4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082518 Aug 24 09:52:47.663199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 967/1948] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:47 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:48.681941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:48.682549 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:48.689022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:48.689520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:48.689956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:48.690647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:48.691097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:48.692053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:48.754508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:48.762722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2672e76a-d1f6-484f-a8fa-a884f1179a11 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084620 Aug 24 09:52:48.766115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 982/1949] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:48 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:49.783095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:49.783738 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:49.790137 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:49.790617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:49.791053 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:49.791785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:49.792243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:49.792671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:49.852994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:49.861040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2a714711-f8f6-44ee-a0ec-43e20d5ee124 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081867 Aug 24 09:52:49.861605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 968/1950] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:49 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:50.882666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:50.883303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:50.889788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:50.890266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:50.890801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:50.891521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:50.892006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:50.892432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:50.954207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:50.963189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ae5ff359-da98-4e3f-ae90-88644bf73445 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084984 Aug 24 09:52:50.963775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 983/1951] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:50 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:51.983421 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:51.984092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:51.990492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:51.990972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:51.991411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:51.992138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:51.992594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:51.993021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:52.055095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:52.063954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-582ff073-10b2-402f-9358-d683a5387263 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.084358 Aug 24 09:52:52.064520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 969/1952] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:51 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:53.089282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:53.089906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:53.096405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:53.096887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:53.097326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:53.098017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:53.098472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:53.098928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:53.158317 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:53.166408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ef6d0986-3393-4698-bbf8-2c661f693140 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.080987 Aug 24 09:52:53.166968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 984/1953] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:53 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:54.187168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:54.187831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:54.194794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:54.195279 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:54.195750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:54.196449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:54.196906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:54.197377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:54.263248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:54.271373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-41813ebf-0452-4a2e-9f79-55d774c6ab47 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.088105 Aug 24 09:52:54.271962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 970/1954] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:54 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:55.291931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:55.292529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:55.298874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:55.299364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:55.299835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:55.300563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:55.301015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:55.301438 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:55.361444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:55.369480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-35e68bb7-8531-4ea1-b608-821eaad241a1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081404 Aug 24 09:52:55.370033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 985/1955] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:55 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:56.389788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:56.390400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:56.397507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:56.398005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:56.398435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:56.399145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:56.399611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:56.400039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:56.460717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:56.468881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b1ad29fa-5b47-49b9-95c7-14a295870fa5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.082930 Aug 24 09:52:56.469439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 971/1956] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:56 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:57.489653 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:57.490267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:57.496877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:57.497360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:57.497797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:57.498618 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:57.499071 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:57.499498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:57.559850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:57.568596 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9a991755-5902-4772-8c0e-a3ed80e58e2d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.083263 Aug 24 09:52:57.570716 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 986/1957] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:57 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:58.589379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:58.589994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:52:58.596012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:58.596495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:58.596930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:58.598161 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:52:58.598639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:52:58.599066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:52:58.658597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:52:58.667239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e8fcb36-a671-44cd-bfbe-d91a3a531a4e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 200 len: 1372 microversion: 2.1 time: 0.081901 Aug 24 09:52:58.667827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 972/1958] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:52:58 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 1372 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:52:58.689153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-38f79f85-0483-47ed-b8c4-8b31b5300392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '.version_select at 0x7fa91802aca0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:52:58.780892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-38f79f85-0483-47ed-b8c4-8b31b5300392 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131250624" status: 202 len: 0 microversion: 2.1 time: 0.095546 Aug 24 09:52:58.781472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 987/1959] 10.222.0.16 () {58 vars in 1221 bytes} [Wed Aug 24 09:52:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1131250624 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 09:52:59.732130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1d12960f-9354-4cc8-9273-82eb8f54ca2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: .version_select at 0x7fa912f99d30>, body: {"keypair": {"name": "tempest-keypair-536183724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQaBkzJrKuTQ/PMdKgIg1pb2Nfa/fK7n+FdQweC6rz3tfARvS7tNnEuU0nhn+Sx9E77l52BMOOeCtCe0wQ48WZLTkw50e291FtiAfwM+Z7oeBsZ7KyBd1JbIVIQARs/sA=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:52:59.749214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-1d12960f-9354-4cc8-9273-82eb8f54ca2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:52:59.754204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-1d12960f-9354-4cc8-9273-82eb8f54ca2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:52:59.766334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1d12960f-9354-4cc8-9273-82eb8f54ca2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [a86719c4-340d-407b-9a87-9d78a6bfaf8a] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 09:53:00.772593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [None req-1d12960f-9354-4cc8-9273-82eb8f54ca2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [a86719c4-340d-407b-9a87-9d78a6bfaf8a] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34476. Aug 24 09:53:00.867611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1d12960f-9354-4cc8-9273-82eb8f54ca2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.139891 Aug 24 09:53:00.868209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 973/1960] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 09:52:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:53:02.961944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-592800352", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d78a8de-2c64-4044-abe6-4ba1346bd716"}], "security_groups": [{"name": "tempest-securitygroup--1670999550"}], "key_name": "tempest-keypair-536183724", "user_data": "}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:53:03.058328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] validate_networks() for [('2d78a8de-2c64-4044-abe6-4ba1346bd716', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 09:53:03.471899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 09:53:03.472952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 09:53:03.473430 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 09:53:03.473840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 09:53:03.474250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 09:53:03.482952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:03.483362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:03.483839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:03.484560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:03.485011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:03.485432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:03.494665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=78 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:03.505015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 09:53:03.508866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 09:53:03.520053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 09:53:03.522375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 09:53:03.647112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6e3a3cba-b2e5-472e-b606-9df15db4dc61 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.696209 Aug 24 09:53:03.647771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 988/1961] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 09:53:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 09:53:03.658923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5dc7761f-247a-4a89-af91-15c860c528d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:03.665657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5dc7761f-247a-4a89-af91-15c860c528d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:03.723901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5dc7761f-247a-4a89-af91-15c860c528d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:03.728185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5dc7761f-247a-4a89-af91-15c860c528d2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1240 microversion: 2.1 time: 0.073609 Aug 24 09:53:03.728742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 974/1962] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:03 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:04.749228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:04.749841 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:04.755906 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:04.756517 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:04.756987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:04.757689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:04.758141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:04.758565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:04.819539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:04.827078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-69c32853-831d-4176-b4a3-808e1d5637c0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1244 microversion: 2.1 time: 0.082527 Aug 24 09:53:04.827659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 989/1963] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:04 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1244 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:05.849507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:05.850109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:05.856448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:05.858637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:05.858637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:05.858637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:05.858637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:05.859045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:05.863425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=78 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:05.931038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:05.938871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-54a1556b-691e-460d-86be-6aa457add7a6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1310 microversion: 2.1 time: 0.093744 Aug 24 09:53:05.939435 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 975/1964] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:05 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1310 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:06.960833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:06.961480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:06.967845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:06.968332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:06.968768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:06.969467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:06.969929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:06.970355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:07.102613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:07.110200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7386c5d3-3dcf-4a01-ba62-062a5a9871fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.154175 Aug 24 09:53:07.114555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 990/1965] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:06 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:07.313760 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f835766-0103-492d-86a7-f3b9f896c37b", "tag": "7955813c-a7c5-47c8-ba15-55938d56036d"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:53:07.323545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:07.324058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:07.324491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:07.336382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] Creating event network-changed:7955813c-a7c5-47c8-ba15-55938d56036d for instance 9f835766-0103-492d-86a7-f3b9f896c37b on hv-cinder-85032 Aug 24 09:53:07.339609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] [043ee913-f0a4-4733-9de1-9cd950fd439c] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 09:53:08.131085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:08.131741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:08.138140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:08.138625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:08.139070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:08.139801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:08.140262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:08.140690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:08.267469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:08.275669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-76713b92-05a4-479a-adb6-a97d8ebcf459 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.148952 Aug 24 09:53:08.276226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 991/1966] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:08 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 09:53:08.346085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] [043ee913-f0a4-4733-9de1-9cd950fd439c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 34534. Aug 24 09:53:08.349670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-6c77fac9-4b65-4034-8797-39bcc2f7c5a9 req-dc6712b1-34a1-4fd5-9514-2bcaf981cdd8 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.162167 Aug 24 09:53:08.350262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 976/1967] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:53:08.500508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:53:08.500673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:53:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:53:09.295766 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:09.296370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:09.302837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:09.303312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:09.304015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:09.304448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:09.304896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:09.305318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:09.434961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:09.442668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a3af028c-02a5-4958-b346-289299130995 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.150771 Aug 24 09:53:09.443344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 992/1968] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:09 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:10.463725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:10.464345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:10.470422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:10.470902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:10.471340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:10.472561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:10.473045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:10.473472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:10.599386 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:10.606940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-50f74469-608f-4bd5-b8ca-4c474bc20a97 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.148099 Aug 24 09:53:10.607494 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 977/1969] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:10 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:11.627845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:11.628578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:11.634865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:11.635415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:11.635958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:11.636648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:11.637097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:11.637518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:11.768147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:11.776319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f175e52b-75ba-42a9-8ebb-057e1d4b4d2f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.152351 Aug 24 09:53:11.776937 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 993/1970] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:11 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:12.797257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:12.797978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:12.804899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:12.805383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:12.805814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:12.806503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:12.806950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:12.807366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:12.935241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:12.943234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4cb54df9-16b5-469c-9a5e-62973a99c0c5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.149932 Aug 24 09:53:12.943916 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 978/1971] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:12 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:13.964671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:13.965351 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:13.967819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.968579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.969606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:13.974839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:13.975331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:13.975809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:13.976522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:13.976981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:13.977415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:14.117900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:14.127104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0243a690-9b0f-43c7-bbb7-a7a9de8449db tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.166317 Aug 24 09:53:14.127697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 994/1972] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:13 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:14.216971 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:14.274884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-5c93808b-5965-462b-bedf-d07069ce9515 req-147403f2-bed9-4a16-9444-b199d538ff4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f835766-0103-492d-86a7-f3b9f896c37b", "name": "network-vif-plugged", "status": "completed", "tag": "7955813c-a7c5-47c8-ba15-55938d56036d"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:53:14.279865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:14.285682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5c93808b-5965-462b-bedf-d07069ce9515 req-147403f2-bed9-4a16-9444-b199d538ff4e service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:14.286165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5c93808b-5965-462b-bedf-d07069ce9515 req-147403f2-bed9-4a16-9444-b199d538ff4e service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:14.286600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5c93808b-5965-462b-bedf-d07069ce9515 req-147403f2-bed9-4a16-9444-b199d538ff4e service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:14.297520 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-5c93808b-5965-462b-bedf-d07069ce9515 req-147403f2-bed9-4a16-9444-b199d538ff4e service nova] Creating event network-vif-plugged:7955813c-a7c5-47c8-ba15-55938d56036d for instance 9f835766-0103-492d-86a7-f3b9f896c37b on hv-cinder-85032 Aug 24 09:53:14.303338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-5c93808b-5965-462b-bedf-d07069ce9515 req-147403f2-bed9-4a16-9444-b199d538ff4e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090554 Aug 24 09:53:14.304216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 979/1973] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:53:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:53:15.147546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:15.148171 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:15.155003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:15.155480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:15.155945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:15.156634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:15.157090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:15.157514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:15.284279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:15.291868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-781ba33f-9134-4404-b4f0-9b4b666e7286 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.148137 Aug 24 09:53:15.292433 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 995/1974] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:15 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:16.315099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:16.315865 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:16.323208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:16.324069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:16.324562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:16.325313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:16.325780 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:16.326458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:16.461203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:16.468767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5505440b-c83d-462d-b6c7-40bde93acf66 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1366 microversion: 2.1 time: 0.159684 Aug 24 09:53:16.470817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 980/1975] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:16 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:17.491084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:17.491722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:17.498118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:17.498597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:17.499032 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:17.499745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:17.500195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:17.500615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:17.626043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:17.633550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8b35c484-67df-42c9-a628-70d5242e1ba8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1557 microversion: 2.1 time: 0.147742 Aug 24 09:53:17.634111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 996/1976] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:17 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:17.653953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:17.654460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:17.661597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:17.662079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:17.662515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:17.663203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:17.663682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:17.664113 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:17.739332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b4b3919d-65c8-4fe4-8b02-14beb84cf3ea tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089373 Aug 24 09:53:17.739959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 981/1977] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Aug 24 09:53:17 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:53:18.931030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-a6b61fb3-49a2-4a7f-b82e-48bc9116044f req-5699cd55-79b1-41fb-9627-2d6a6537347e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f835766-0103-492d-86a7-f3b9f896c37b", "tag": "7955813c-a7c5-47c8-ba15-55938d56036d"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:53:18.940946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a6b61fb3-49a2-4a7f-b82e-48bc9116044f req-5699cd55-79b1-41fb-9627-2d6a6537347e service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:18.942098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a6b61fb3-49a2-4a7f-b82e-48bc9116044f req-5699cd55-79b1-41fb-9627-2d6a6537347e service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:18.942545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a6b61fb3-49a2-4a7f-b82e-48bc9116044f req-5699cd55-79b1-41fb-9627-2d6a6537347e service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:18.954394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-a6b61fb3-49a2-4a7f-b82e-48bc9116044f req-5699cd55-79b1-41fb-9627-2d6a6537347e service nova] Creating event network-changed:7955813c-a7c5-47c8-ba15-55938d56036d for instance 9f835766-0103-492d-86a7-f3b9f896c37b on hv-cinder-85032 Aug 24 09:53:18.961372 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-a6b61fb3-49a2-4a7f-b82e-48bc9116044f req-5699cd55-79b1-41fb-9627-2d6a6537347e service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033690 Aug 24 09:53:18.961957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 997/1978] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:53:32.418141 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=5 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.418898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=31 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.422745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:32.423242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:32.428990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.429463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.429900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.430595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.431048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.431472 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.444938 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] HTTP exception thrown: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Request method failure captured: Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b HTTP/1.1 Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8mM3Ug07VOcptQ0Yj1o3-Tz1EgPakdk8vikxbKE6MDN6hZ7lrvV8xnDHazAir6NUuwBhkpnJaB_KLKmGNKcD-WWlqyjsvAPwMZ6XhdCCsfobvlPzWpgFPs3o1Bc22ChZSy4-J_sGL7HYOXBFcB2HOjVU_roXNwZ6nAcY91-qUMa9o Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:53:32.446621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00ce4a2669e43dcb5bc8a2d77b11c2f", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: cbcaa84bc9c54d7aa4178d0174a5936e Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.448563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'f7305802-e1e6-46dc-a090-0748e35d748b'} Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:53:32.449876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.451892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.454025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Returning 404 to user: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:53:32.454025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6d50a17a-6f76-44b5-9d25-5a982dbfdc01 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 404 len: 111 microversion: 2.20 time: 0.031430 Aug 24 09:53:32.454025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 982/1979] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Aug 24 09:53:32 2022] DELETE /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:53:32.457070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:32.458692 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: f7305802-e1e6-46dc-a090-0748e35d748b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:32.459913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:32.460507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:32.464885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=7 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.465682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=51 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:53:32.466728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.467255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.467357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.467668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.467805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.468233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.468347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.468831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.468965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.469226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.469591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.470024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.484982 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] HTTP exception thrown: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.495226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] HTTP exception thrown: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Request method failure captured: Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b HTTP/1.1 Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8mM3Ug07VOcptQ0Yj1o3-Tz1EgPakdk8vikxbKE6MDN6hZ7lrvV8xnDHazAir6NUuwBhkpnJaB_KLKmGNKcD-WWlqyjsvAPwMZ6XhdCCsfobvlPzWpgFPs3o1Bc22ChZSy4-J_sGL7HYOXBFcB2HOjVU_roXNwZ6nAcY91-qUMa9o Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:53:32.496120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00ce4a2669e43dcb5bc8a2d77b11c2f", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: cbcaa84bc9c54d7aa4178d0174a5936e Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.497682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'f7305802-e1e6-46dc-a090-0748e35d748b'} Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:53:32.499881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. Aug 24 09:53:32.501356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.502589 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Returning 404 to user: Instance f7305802-e1e6-46dc-a090-0748e35d748b could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Request method failure captured: Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee HTTP/1.1 Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8pD5JntjOIDel1FeefqltliRCbc8jhDmwpoJ1AGKlrql1sjCNop2osA4DN5R4KVIwhGobez73bk65_QS0kIbmkcsDbH8aAGj1kd_YA8kK_j-0PdbnMb-Gl4ASuHbIUnzuFdEnJ-YfoQRPZD7dV4T_DgsVXyzpeBBYJTAg0vidot_8 Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:53:32.502707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803ce13612e0460682ef8b4d42781a99", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b9099dc3ad92431cbac98f144690038c Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.504810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'b7384e8a-d236-4e15-9dbf-6caf3034ceee'} Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:53:32.506518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.510672 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.512347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f907dc10-14c4-400d-8a53-ee72efcb8b5e tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b" status: 404 len: 111 microversion: 2.20 time: 0.035271 Aug 24 09:53:32.512464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Returning 404 to user: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:53:32.512571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 998/1980] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:53:32 2022] GET /compute/v2.1/servers/f7305802-e1e6-46dc-a090-0748e35d748b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 24 09:53:32.512684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f3cf2837-a0ff-48d1-8417-e9571b241c6c tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 404 len: 111 microversion: 2.1 time: 0.036683 Aug 24 09:53:32.512684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 983/1981] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:53:32 2022] DELETE /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 09:53:32.512884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:32.512884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: b7384e8a-d236-4e15-9dbf-6caf3034ceee] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:32.512884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.512884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.513309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.513309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.513309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.513309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.513697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:32.513697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:32.518611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.519254 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.519642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.521259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.521726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.522157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.524259 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] HTTP exception thrown: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Request method failure captured: Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee HTTP/1.1 Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8pD5JntjOIDel1FeefqltliRCbc8jhDmwpoJ1AGKlrql1sjCNop2osA4DN5R4KVIwhGobez73bk65_QS0kIbmkcsDbH8aAGj1kd_YA8kK_j-0PdbnMb-Gl4ASuHbIUnzuFdEnJ-YfoQRPZD7dV4T_DgsVXyzpeBBYJTAg0vidot_8 Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:53:32.525827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803ce13612e0460682ef8b4d42781a99", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: b9099dc3ad92431cbac98f144690038c Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.529434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'b7384e8a-d236-4e15-9dbf-6caf3034ceee'} Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:53:32.531174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. Aug 24 09:53:32.532865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:32.534868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Returning 404 to user: Instance b7384e8a-d236-4e15-9dbf-6caf3034ceee could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:53:32.534868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9ffc82d5-553b-488b-92c4-a253b0bd6b7f tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee" status: 404 len: 111 microversion: 2.1 time: 0.030887 Aug 24 09:53:32.534868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 999/1982] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:32 2022] GET /compute/v2.1/servers/b7384e8a-d236-4e15-9dbf-6caf3034ceee => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:53:32.549588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:53:32.785681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fcf0f2da-2fc5-4dcd-a8d1-9fecc0d510e1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 204 len: 0 microversion: 2.1 time: 0.277460 Aug 24 09:53:32.786268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 984/1983] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:53:32 2022] DELETE /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:32.794647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:32.795260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:32.801413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.801870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.802306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.802999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:32.803459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:32.803912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:32.943576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:32.951301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7d88a0ca-cf1a-4c10-b31a-ede49a032768 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1508 microversion: 2.1 time: 0.160839 Aug 24 09:53:32.951913 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1000/1984] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:32 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:33.975300 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:33.976036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:33.982694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:33.983261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:33.983838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:33.984572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:33.985027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:33.985504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:34.158504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:34.167047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8eace6e1-4d91-4c5c-b4a6-ebdb8c06229c tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1508 microversion: 2.1 time: 0.196626 Aug 24 09:53:34.167619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 985/1985] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:33 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:34.296714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-a1bea65e-6d8f-4d91-845a-1ca86a7e09d6 req-c6882a63-529b-4b0c-b64f-de45464c0c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5343e07-144f-42bb-b966-2db846f99964", "name": "network-vif-deleted", "tag": "3ebb5115-328b-42f9-b5fc-c02856ef0d4c"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:53:34.308240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a1bea65e-6d8f-4d91-845a-1ca86a7e09d6 req-c6882a63-529b-4b0c-b64f-de45464c0c5f service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:34.308240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a1bea65e-6d8f-4d91-845a-1ca86a7e09d6 req-c6882a63-529b-4b0c-b64f-de45464c0c5f service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:34.308240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a1bea65e-6d8f-4d91-845a-1ca86a7e09d6 req-c6882a63-529b-4b0c-b64f-de45464c0c5f service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:34.320130 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-a1bea65e-6d8f-4d91-845a-1ca86a7e09d6 req-c6882a63-529b-4b0c-b64f-de45464c0c5f service nova] Creating event network-vif-deleted:3ebb5115-328b-42f9-b5fc-c02856ef0d4c for instance a5343e07-144f-42bb-b966-2db846f99964 on hv-cinder-85032 Aug 24 09:53:34.325247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-a1bea65e-6d8f-4d91-845a-1ca86a7e09d6 req-c6882a63-529b-4b0c-b64f-de45464c0c5f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032516 Aug 24 09:53:34.326181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1001/1986] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:53:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:53:35.186992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:35.187670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:35.194616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:35.195107 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:35.195549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:35.196285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:35.196745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:35.197177 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:35.228316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:35.228807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:35.229248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:35.229697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lazy-loading 'fault' on Instance uuid a5343e07-144f-42bb-b966-2db846f99964 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:53:35.274609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:35.282317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-329cfe01-5c3d-4832-834f-2328be5209f9 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 200 len: 1311 microversion: 2.1 time: 0.099185 Aug 24 09:53:35.282912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 986/1987] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:35 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:36.304440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:36.305103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: a5343e07-144f-42bb-b966-2db846f99964] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:36.311411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:36.311917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:36.312355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:36.313041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:36.313491 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:36.313912 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:36.327700 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] HTTP exception thrown: Instance a5343e07-144f-42bb-b966-2db846f99964 could not be found. Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Request method failure captured: Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 HTTP/1.1 Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe-TECnAWFRqk2BJPqP2-p2HZ2FIj0WbaJcg1hsSoR_01ATvBuGQsE333CvTIF8qCC0WCHeY5-ncjWowna-FLVg79rgVXhG6K2RKGz0YWWlGzvC_O_G9ojDislDHFa_l6hBwzvYWFCYNDcoLSkGsGJ_BAfxairf-5mWS-TLdNMROQLs Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:53:36.329347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a0a723d97d24385875a287252f57f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a0a723d97d24385875a287252f57f02", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 0aff36cf71984238b8a9b998043ec7be Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance a5343e07-144f-42bb-b966-2db846f99964 could not be found. Aug 24 09:53:36.331186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'a5343e07-144f-42bb-b966-2db846f99964'} Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5343e07-144f-42bb-b966-2db846f99964 could not be found. Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:53:36.332688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5343e07-144f-42bb-b966-2db846f99964 could not be found. Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5343e07-144f-42bb-b966-2db846f99964 could not be found. Aug 24 09:53:36.334477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:36.336069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Returning 404 to user: Instance a5343e07-144f-42bb-b966-2db846f99964 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:53:36.336069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-97e11755-f5ea-4b3e-b3e2-8888dfeb46d5 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964" status: 404 len: 111 microversion: 2.1 time: 0.031770 Aug 24 09:53:36.336069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1002/1988] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:36 2022] GET /compute/v2.1/servers/a5343e07-144f-42bb-b966-2db846f99964 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:53:36.339523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:36.340048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:36.346393 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:36.346875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:36.347309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:36.348028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:36.348484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:36.348912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:36.375038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 09:53:36.647340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2979d5c8-fdb2-4113-a2af-cbb5c56af5d0 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "DELETE /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 204 len: 0 microversion: 2.1 time: 0.311437 Aug 24 09:53:36.647954 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 987/1989] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:53:36 2022] DELETE /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 09:53:36.655936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:36.656581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:36.663080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:36.663550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:36.664010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:36.664691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:36.665141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:36.665565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:36.794664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:36.802907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e10bb75e-8261-4710-bdab-a604b42ec8a1 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.150272 Aug 24 09:53:36.803464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1003/1990] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:36 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:37.824906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:37.825600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:37.831932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:37.832664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:37.833144 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:37.833828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:37.834278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:37.834702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:38.053242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:38.061808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dc303a2e-e4a7-4d88-bbc7-b4cbcc60e212 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1522 microversion: 2.1 time: 0.241058 Aug 24 09:53:38.062375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 988/1991] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:37 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:38.434677 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-414d7c7f-ee46-49bf-b0bd-bd68a0f123d8 req-38fd0f0f-8980-49df-aa5b-17b0ec470ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10a2f38e-6e14-434b-a628-cacaecbb1492", "name": "network-vif-deleted", "tag": "391ff95c-c037-4aa0-89d4-3d2d917b9473"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:53:38.444796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-414d7c7f-ee46-49bf-b0bd-bd68a0f123d8 req-38fd0f0f-8980-49df-aa5b-17b0ec470ae7 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:38.450339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-414d7c7f-ee46-49bf-b0bd-bd68a0f123d8 req-38fd0f0f-8980-49df-aa5b-17b0ec470ae7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:38.450339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-414d7c7f-ee46-49bf-b0bd-bd68a0f123d8 req-38fd0f0f-8980-49df-aa5b-17b0ec470ae7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:38.457765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-414d7c7f-ee46-49bf-b0bd-bd68a0f123d8 req-38fd0f0f-8980-49df-aa5b-17b0ec470ae7 service nova] Creating event network-vif-deleted:391ff95c-c037-4aa0-89d4-3d2d917b9473 for instance 10a2f38e-6e14-434b-a628-cacaecbb1492 on hv-cinder-85032 Aug 24 09:53:38.463685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-414d7c7f-ee46-49bf-b0bd-bd68a0f123d8 req-38fd0f0f-8980-49df-aa5b-17b0ec470ae7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032654 Aug 24 09:53:38.464280 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1004/1992] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:53:39.082634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:39.083805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:39.090163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:39.090647 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:39.091088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:39.091810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:39.092262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:39.092688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:39.123326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:39.123850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:39.124288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:39.124746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lazy-loading 'fault' on Instance uuid 10a2f38e-6e14-434b-a628-cacaecbb1492 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 09:53:39.165907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aff36cf71984238b8a9b998043ec7be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a0a723d97d24385875a287252f57f02', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 09:53:39.173511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e3a59c91-f392-4beb-a4f8-23a386dc4c67 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 200 len: 1312 microversion: 2.1 time: 0.095048 Aug 24 09:53:39.174070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 989/1993] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:39 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 1312 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 09:53:40.195477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:53:40.196195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] [instance: 10a2f38e-6e14-434b-a628-cacaecbb1492] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:53:40.202365 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:40.202745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:40.203181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:40.203891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:53:40.204349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:53:40.204856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:53:40.218588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] HTTP exception thrown: Instance 10a2f38e-6e14-434b-a628-cacaecbb1492 could not be found. Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Request method failure captured: Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 HTTP/1.1 Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe-TECnAWFRqk2BJPqP2-p2HZ2FIj0WbaJcg1hsSoR_01ATvBuGQsE333CvTIF8qCC0WCHeY5-ncjWowna-FLVg79rgVXhG6K2RKGz0YWWlGzvC_O_G9ojDislDHFa_l6hBwzvYWFCYNDcoLSkGsGJ_BAfxairf-5mWS-TLdNMROQLs Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:53:40.220237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/7a0a723d97d24385875a287252f57f02"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/7a0a723d97d24385875a287252f57f02"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_7a0a723d97d24385875a287252f57f02", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 7a0a723d97d24385875a287252f57f02 Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040718176 Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 0aff36cf71984238b8a9b998043ec7be Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040718176-project Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 10a2f38e-6e14-434b-a628-cacaecbb1492 could not be found. Aug 24 09:53:40.222000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '10a2f38e-6e14-434b-a628-cacaecbb1492'} Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10a2f38e-6e14-434b-a628-cacaecbb1492 could not be found. Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:53:40.223010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10a2f38e-6e14-434b-a628-cacaecbb1492 could not be found. Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10a2f38e-6e14-434b-a628-cacaecbb1492 could not be found. Aug 24 09:53:40.224704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:53:40.226273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] Returning 404 to user: Instance 10a2f38e-6e14-434b-a628-cacaecbb1492 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:53:40.226273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b527185f-f986-4a59-a369-e761f2819462 tempest-ServerRescueNegativeTestJSON-1040718176 tempest-ServerRescueNegativeTestJSON-1040718176-project] 10.222.0.16 "GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492" status: 404 len: 111 microversion: 2.1 time: 0.031366 Aug 24 09:53:40.226273 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1005/1994] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:53:40 2022] GET /compute/v2.1/servers/10a2f38e-6e14-434b-a628-cacaecbb1492 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:54:34.269894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:54:34.270403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:54:34.272565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:34.273218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:54:34.277864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:54:34.278340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:54:34.278778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:54:34.279465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:54:34.279944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:54:34.280366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:54:34.303055 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4c46e9c6-3c3b-4420-8674-75130c46e4d1 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/ips" status: 200 len: 151 microversion: 2.1 time: 0.037207 Aug 24 09:54:34.303641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 990/1995] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 09:54:34 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:56:28.508278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:56:28.508970 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:56:43.042250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:56:43.042930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:56:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:57:35.049642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 09:57:35.050612 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=16 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:35.051441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=24 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:57:35.055441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-257d5913-4a4c-4262-8b47-8111e144ec83 req-cc790f99-b7e0-454d-a1d9-2d08be498998 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fca9f952-e8e8-425b-9f7b-cc3132ad26ce", "name": "network-vif-deleted", "tag": "90b6cdf2-7f40-422d-a879-9d83ffb80aad"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:57:35.067239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-257d5913-4a4c-4262-8b47-8111e144ec83 req-cc790f99-b7e0-454d-a1d9-2d08be498998 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:57:35.067753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-257d5913-4a4c-4262-8b47-8111e144ec83 req-cc790f99-b7e0-454d-a1d9-2d08be498998 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:57:35.068187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-257d5913-4a4c-4262-8b47-8111e144ec83 req-cc790f99-b7e0-454d-a1d9-2d08be498998 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:57:35.078864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-257d5913-4a4c-4262-8b47-8111e144ec83 req-cc790f99-b7e0-454d-a1d9-2d08be498998 service nova] Creating event network-vif-deleted:90b6cdf2-7f40-422d-a879-9d83ffb80aad for instance fca9f952-e8e8-425b-9f7b-cc3132ad26ce on hv-cinder-85032 Aug 24 09:57:35.085452 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-257d5913-4a4c-4262-8b47-8111e144ec83 req-cc790f99-b7e0-454d-a1d9-2d08be498998 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037535 Aug 24 09:57:35.086051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1006/1996] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 09:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:58:01.479995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:58:01.480725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:58:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:58:10.099754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:58:10.100396 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:58:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:58:10.979000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:58:10.979468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 09:58:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:59:32.945038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 09:59:32.949207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:32.949711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:59:32.957673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:32.958105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:32.958546 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:32.959238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:32.959727 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:32.963183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:32.975011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] HTTP exception thrown: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Request method failure captured: Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 HTTP/1.1 Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8pD5JntjOIDel1FeefqltliRCbc8jhDmwpoJ1AGKlrql1sjCNop2osA4DN5R4KVIwhGobez73bk65_QS0kIbmkcsDbH8aAGj1kd_YA8kK_j-0PdbnMb-Gl4ASuHbIUnzuFdEnJ-YfoQRPZD7dV4T_DgsVXyzpeBBYJTAg0vidot_8 Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:59:32.976658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803ce13612e0460682ef8b4d42781a99", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b9099dc3ad92431cbac98f144690038c Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:32.978792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '25c65cee-4bde-44b8-844d-9f4a6aac5208'} Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:59:32.979499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:32.985509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:32.986492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Returning 404 to user: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:59:32.986492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-79ab9b01-fb72-48e1-a8d3-03124e42437a tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "DELETE /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 404 len: 111 microversion: 2.1 time: 0.036258 Aug 24 09:59:32.986492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 991/1997] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 09:59:32 2022] DELETE /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:59:32.988200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:32.997697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:32.998051 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:59:32.998130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] [instance: 25c65cee-4bde-44b8-844d-9f4a6aac5208] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:59:32.998195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:32.998195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:32.998195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:32.998381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:32.998381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:32.998507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:32.998572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:32.998656 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:32.998722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:32.998791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:32.998856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:32.999023 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:33.017578 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] HTTP exception thrown: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Request method failure captured: Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 HTTP/1.1 Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8pD5JntjOIDel1FeefqltliRCbc8jhDmwpoJ1AGKlrql1sjCNop2osA4DN5R4KVIwhGobez73bk65_QS0kIbmkcsDbH8aAGj1kd_YA8kK_j-0PdbnMb-Gl4ASuHbIUnzuFdEnJ-YfoQRPZD7dV4T_DgsVXyzpeBBYJTAg0vidot_8 Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:59:33.020629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/803ce13612e0460682ef8b4d42781a99"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_803ce13612e0460682ef8b4d42781a99", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 803ce13612e0460682ef8b4d42781a99 Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeTestJSON-37780881 Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: b9099dc3ad92431cbac98f144690038c Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeTestJSON-37780881-project Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:33.021899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '25c65cee-4bde-44b8-844d-9f4a6aac5208'} Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:59:33.026926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. Aug 24 09:59:33.028224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.029248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] Returning 404 to user: Instance 25c65cee-4bde-44b8-844d-9f4a6aac5208 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:59:33.029330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36206. Aug 24 09:59:33.029416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2c883a10-31e6-4bb4-bea4-37df6fc168c3 tempest-AttachVolumeTestJSON-37780881 tempest-AttachVolumeTestJSON-37780881-project] 10.222.0.16 "GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208" status: 404 len: 111 microversion: 2.1 time: 0.036715 Aug 24 09:59:33.029416 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 992/1998] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 09:59:32 2022] GET /compute/v2.1/servers/25c65cee-4bde-44b8-844d-9f4a6aac5208 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] HTTP exception thrown: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Request method failure captured: Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: DELETE /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc HTTP/1.1 Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8mM3Ug07VOcptQ0Yj1o3-Tz1EgPakdk8vikxbKE6MDN6hZ7lrvV8xnDHazAir6NUuwBhkpnJaB_KLKmGNKcD-WWlqyjsvAPwMZ6XhdCCsfobvlPzWpgFPs3o1Bc22ChZSy4-J_sGL7HYOXBFcB2HOjVU_roXNwZ6nAcY91-qUMa9o Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 09:59:33.029557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00ce4a2669e43dcb5bc8a2d77b11c2f", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: cbcaa84bc9c54d7aa4178d0174a5936e Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.030910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '9e093c82-b762-45aa-840b-26b6b982f8bc'} Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:59:33.034302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.036588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.038439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Returning 404 to user: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:59:33.038439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-504a2e54-0ba4-4a70-a47d-a7767beac511 tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 404 len: 111 microversion: 2.20 time: 0.050549 Aug 24 09:59:33.038439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1007/1999] 10.222.0.16 () {60 vars in 1280 bytes} [Wed Aug 24 09:59:32 2022] DELETE /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:59:33.041667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:33.044167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] [instance: 9e093c82-b762-45aa-840b-26b6b982f8bc] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 09:59:33.050692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:33.051177 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:33.051628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:33.052324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 09:59:33.054038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 09:59:33.054490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] HTTP exception thrown: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Request method failure captured: Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc HTTP/1.1 Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8mM3Ug07VOcptQ0Yj1o3-Tz1EgPakdk8vikxbKE6MDN6hZ7lrvV8xnDHazAir6NUuwBhkpnJaB_KLKmGNKcD-WWlqyjsvAPwMZ6XhdCCsfobvlPzWpgFPs3o1Bc22ChZSy4-J_sGL7HYOXBFcB2HOjVU_roXNwZ6nAcY91-qUMa9o Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Openstack-Nova-Api-Version: 2.20 Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 09:59:33.075697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/d00ce4a2669e43dcb5bc8a2d77b11c2f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_d00ce4a2669e43dcb5bc8a2d77b11c2f", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: d00ce4a2669e43dcb5bc8a2d77b11c2f Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1957311926 Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: cbcaa84bc9c54d7aa4178d0174a5936e Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1957311926-project Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.076965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '9e093c82-b762-45aa-840b-26b6b982f8bc'} Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 09:59:33.077543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. Aug 24 09:59:33.078933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 09:59:33.079822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] Returning 404 to user: Instance 9e093c82-b762-45aa-840b-26b6b982f8bc could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 09:59:33.079822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-257da643-0ae5-4c12-b8a6-cd309a41323f tempest-AttachVolumeShelveTestJSON-1957311926 tempest-AttachVolumeShelveTestJSON-1957311926-project] 10.222.0.16 "GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc" status: 404 len: 111 microversion: 2.20 time: 0.040692 Aug 24 09:59:33.079822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 993/2000] 10.222.0.16 () {60 vars in 1277 bytes} [Wed Aug 24 09:59:33 2022] GET /compute/v2.1/servers/9e093c82-b762-45aa-840b-26b6b982f8bc => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 24 09:59:40.198059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-00dc0a5b-ad41-41bb-8fdf-5ef2e9097ffd tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Action: 'create', calling method: .version_select at 0x7fa91b6ed790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-560855316"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 09:59:41.518536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-00dc0a5b-ad41-41bb-8fdf-5ef2e9097ffd tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.469657 Aug 24 09:59:41.519180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1008/2001] 10.222.0.16 () {60 vars in 1155 bytes} [Wed Aug 24 09:59:40 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1471 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 24 09:59:41.531266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ebe9782-a3f8-4319-ba2e-02f5eb87135e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:41.545726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 36382. Aug 24 09:59:41.631006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ebe9782-a3f8-4319-ba2e-02f5eb87135e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.103443 Aug 24 09:59:41.631665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 994/2002] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:41 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:42.645139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-04a5dd41-2328-4cb1-ae3f-2ed8c26c5d2f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8c670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:42.690144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-04a5dd41-2328-4cb1-ae3f-2ed8c26c5d2f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049226 Aug 24 09:59:42.690707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1009/2003] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:42 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:43.701784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=8 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:43.705968 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ba0f1915-440a-4ba1-9549-c82817558c52 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:43.753431 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ba0f1915-440a-4ba1-9549-c82817558c52 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052881 Aug 24 09:59:43.753995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 995/2004] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:43 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:44.762987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=4 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:44.763765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=4 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:44.768129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d47d0a26-ebad-42ff-a8a7-7c169df785f5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ef73a0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:44.814595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d47d0a26-ebad-42ff-a8a7-7c169df785f5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052298 Aug 24 09:59:44.815152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1010/2005] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:44 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:45.828729 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-71f13abb-8c10-427d-8134-f1efd01d0f36 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecdee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:45.876662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-71f13abb-8c10-427d-8134-f1efd01d0f36 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052134 Aug 24 09:59:45.877217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 996/2006] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:45 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:46.890590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-36af73b6-a7d5-4041-a0ea-4ed0f85feae9 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1160>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:46.937577 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-36af73b6-a7d5-4041-a0ea-4ed0f85feae9 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051210 Aug 24 09:59:46.938090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1011/2007] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:46 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:47.950503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-560889f2-6a9a-4368-a839-3358ae7ae371 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24d30>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:47.995621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-560889f2-6a9a-4368-a839-3358ae7ae371 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049311 Aug 24 09:59:47.996270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 997/2008] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:47 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:48.516265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 09:59:48.516420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 09:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 09:59:49.009186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-84135708-2290-4826-9452-7c389decd3ac tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6edf70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:49.053417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-84135708-2290-4826-9452-7c389decd3ac tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048389 Aug 24 09:59:49.053996 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1012/2009] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:49 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:50.066982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bb25fd58-7cac-4dae-a855-5e4fe5783968 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e471f0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:50.115097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bb25fd58-7cac-4dae-a855-5e4fe5783968 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052097 Aug 24 09:59:50.115685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 998/2010] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:50 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:51.129532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e2bead8e-721c-403b-a304-8aa505ed9222 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd9d30>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:51.178099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e2bead8e-721c-403b-a304-8aa505ed9222 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052811 Aug 24 09:59:51.178651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1013/2011] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:51 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:52.190657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=10 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 09:59:52.194606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-106a1a1a-6179-419f-8b14-6d10de82d445 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68db80>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:52.255273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-106a1a1a-6179-419f-8b14-6d10de82d445 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.065663 Aug 24 09:59:52.255885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 999/2012] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:52 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:53.269746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-977c0363-5730-42df-b288-dd0fb4fe49a5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810b9d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:53.319819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-977c0363-5730-42df-b288-dd0fb4fe49a5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.054134 Aug 24 09:59:53.320419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1014/2013] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:53 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:54.334504 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-00a7fa47-ed2c-4efe-90b1-4816b10f39eb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24310>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:54.389530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-00a7fa47-ed2c-4efe-90b1-4816b10f39eb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059675 Aug 24 09:59:54.390089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1000/2014] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:54 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:55.403729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-71e04b1d-9071-4132-ae30-734e7a53e5f4 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8c670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:55.461341 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-71e04b1d-9071-4132-ae30-734e7a53e5f4 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061409 Aug 24 09:59:55.461923 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1015/2015] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:55 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:56.474458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dcf6c4fa-5413-44ea-9569-2749bde29d78 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91814df70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:56.529300 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dcf6c4fa-5413-44ea-9569-2749bde29d78 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059022 Aug 24 09:59:56.529859 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1001/2016] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:56 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:57.542712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ea210d2b-49f4-4551-b889-553796582a75 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6ed040>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:57.603362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ea210d2b-49f4-4551-b889-553796582a75 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.065044 Aug 24 09:59:57.603965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1016/2017] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:57 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:58.617178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2e81bc57-e40b-4851-9fed-3653d1e3cdd7 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ead430>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:58.674150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2e81bc57-e40b-4851-9fed-3653d1e3cdd7 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061291 Aug 24 09:59:58.674709 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1002/2018] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:58 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 09:59:59.688228 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bcb1b077-f132-42e9-ac60-0646b6eb69ee tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e339d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 09:59:59.743617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bcb1b077-f132-42e9-ac60-0646b6eb69ee tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059810 Aug 24 09:59:59.744178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1017/2019] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 09:59:59 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:00.758333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e15b0cc-f9af-4bc6-8ed3-2d49cb9b94f2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68ddc0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:00.815717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e15b0cc-f9af-4bc6-8ed3-2d49cb9b94f2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062209 Aug 24 10:00:00.816375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1003/2020] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:00 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:01.831725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d3d504ea-6a7b-47e5-a422-cd4c0dfc1b78 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912df6790>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:01.886490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d3d504ea-6a7b-47e5-a422-cd4c0dfc1b78 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059138 Aug 24 10:00:01.887049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1018/2021] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:01 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:02.901061 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-05265375-3a1f-4234-9f89-63f6274d6770 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e47af0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:02.959502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-05265375-3a1f-4234-9f89-63f6274d6770 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063308 Aug 24 10:00:02.960132 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1004/2022] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:02 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:03.050486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:00:03.050666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:00:03.974390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9e7cbc44-4d12-4944-9d0d-e26e7707d809 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f4d670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:04.029794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9e7cbc44-4d12-4944-9d0d-e26e7707d809 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059931 Aug 24 10:00:04.030411 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1019/2023] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:03 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:05.044826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2d456afe-d609-4b0c-b050-6b2a50a4c885 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d940>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:05.104972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2d456afe-d609-4b0c-b050-6b2a50a4c885 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.064743 Aug 24 10:00:05.105531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1005/2024] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:05 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:06.119118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-17da5c26-6f08-4958-be36-2ba3032be794 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33ee0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:06.169888 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-17da5c26-6f08-4958-be36-2ba3032be794 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.055618 Aug 24 10:00:06.170451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1020/2025] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:06 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:07.184749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bbea971b-7d29-4412-b83e-e3d59251c803 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912c8c820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:07.243249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bbea971b-7d29-4412-b83e-e3d59251c803 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062125 Aug 24 10:00:07.243861 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1006/2026] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:07 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:08.256938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-54948200-27f1-4b45-8111-8c3158660020 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f4d670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:08.314390 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-54948200-27f1-4b45-8111-8c3158660020 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061725 Aug 24 10:00:08.314956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1021/2027] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:08 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:09.334800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6fc5f1a1-705d-4763-b1b2-35c81245d225 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d5e0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:09.382766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6fc5f1a1-705d-4763-b1b2-35c81245d225 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052538 Aug 24 10:00:09.383325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1007/2028] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:09 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:10.397190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-efb17f1f-3adf-4420-90bf-b371f81d0ce2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912df6790>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:10.455062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-efb17f1f-3adf-4420-90bf-b371f81d0ce2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062057 Aug 24 10:00:10.455931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1022/2029] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:10 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:11.469324 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c12b7ad1-8c31-4422-a679-4f75e89ac46d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707670>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:11.524751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c12b7ad1-8c31-4422-a679-4f75e89ac46d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059624 Aug 24 10:00:11.525317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1008/2030] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:11 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:12.538557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9873aaa7-f3e6-400c-8f38-973b24559c7a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:12.601952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9873aaa7-f3e6-400c-8f38-973b24559c7a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.067604 Aug 24 10:00:12.602574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1023/2031] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:12 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:13.617740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-da89d527-c6ff-403b-a2eb-522cdec2d937 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69daf0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:13.672802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-da89d527-c6ff-403b-a2eb-522cdec2d937 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059454 Aug 24 10:00:13.673467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1009/2032] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:13 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:14.686509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-dd032438-b13f-4927-ae27-6bd5a6e4fd7a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd9e50>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:14.737932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-dd032438-b13f-4927-ae27-6bd5a6e4fd7a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.055640 Aug 24 10:00:14.738502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1024/2033] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:14 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:15.752075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bc0ea35b-013c-4558-b105-fae9740283c2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707160>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:15.810898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bc0ea35b-013c-4558-b105-fae9740283c2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063344 Aug 24 10:00:15.811542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1010/2034] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:15 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:00:16.825355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a2b7c05d-ac79-4055-907b-4b83891b6060 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33280>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:16.880882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a2b7c05d-ac79-4055-907b-4b83891b6060 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.060306 Aug 24 10:00:16.881569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1025/2035] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:16 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:17.894449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-87161f93-9c60-4f07-a0b0-1ec9443adc7a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d3a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:17.976414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-87161f93-9c60-4f07-a0b0-1ec9443adc7a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.086116 Aug 24 10:00:17.977841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1011/2036] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:17 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:19.047968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-083f1120-f55a-456b-b3a4-966d29748409 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a4c0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:19.095752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-083f1120-f55a-456b-b3a4-966d29748409 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052210 Aug 24 10:00:19.096327 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1026/2037] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:19 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:20.109524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-864f200b-5ff8-430e-9954-597322f45ddb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d1a160>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:20.154885 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-864f200b-5ff8-430e-9954-597322f45ddb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049475 Aug 24 10:00:20.155469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1012/2038] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:20 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:00:20.905235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:00:20.905738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:00:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:00:21.169373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d297efa4-fc20-4749-bf04-74e239bf922f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33f70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:21.214713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d297efa4-fc20-4749-bf04-74e239bf922f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.050165 Aug 24 10:00:21.215261 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1027/2039] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:21 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:22.228176 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6c76f264-7abe-4c45-95ca-0f1c896e462c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d940>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:22.272997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6c76f264-7abe-4c45-95ca-0f1c896e462c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049037 Aug 24 10:00:22.273555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1013/2040] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:22 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:23.286348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-381a9238-c6ab-481f-930e-72e8ee55765a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810b790>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:23.333340 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-381a9238-c6ab-481f-930e-72e8ee55765a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051065 Aug 24 10:00:23.333969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1028/2041] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:23 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:24.347530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e01290d5-906b-45d3-a925-29527d7a1f1b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69d3a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:24.392100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e01290d5-906b-45d3-a925-29527d7a1f1b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048927 Aug 24 10:00:24.392689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1014/2042] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:24 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:25.406336 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fe3a062e-8215-4fcd-9ff6-bc88fdbb2cfa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a3a0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:25.452453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fe3a062e-8215-4fcd-9ff6-bc88fdbb2cfa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.050221 Aug 24 10:00:25.453003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1029/2043] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:25 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:26.466761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68f15364-8ab2-4277-9883-c5d6a7ed918e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d1a8b0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:26.524285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68f15364-8ab2-4277-9883-c5d6a7ed918e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061899 Aug 24 10:00:26.524894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1015/2044] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:26 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:27.538246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a285e014-112d-4b9c-b4d5-470f3d90e52b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1310>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:27.592833 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a285e014-112d-4b9c-b4d5-470f3d90e52b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058952 Aug 24 10:00:27.593395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1030/2045] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:27 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:28.606592 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-95adf4e6-1873-49a0-a2b6-be1243fa5132 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:28.663321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-95adf4e6-1873-49a0-a2b6-be1243fa5132 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.060996 Aug 24 10:00:28.663914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1016/2046] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:28 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:29.677531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ff4d6fc6-5930-44c8-b2be-dd74cd1dd075 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f1a1f0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:29.738226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ff4d6fc6-5930-44c8-b2be-dd74cd1dd075 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.064937 Aug 24 10:00:29.738793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1031/2047] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:29 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:30.756708 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-56d21dd9-0a11-42a0-8b46-778fd90b648d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d4c0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:30.817905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-56d21dd9-0a11-42a0-8b46-778fd90b648d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.069457 Aug 24 10:00:30.818510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1017/2048] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:30 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:31.832606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-06023184-facc-4474-bece-1378a969f335 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f4d3a0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:31.880124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-06023184-facc-4474-bece-1378a969f335 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051898 Aug 24 10:00:31.880679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1032/2049] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:31 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:32.893943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-defd5b4a-8d51-4375-be9a-13d0b087b6b3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:32.950481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-defd5b4a-8d51-4375-be9a-13d0b087b6b3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.060631 Aug 24 10:00:32.951052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1018/2050] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:32 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:33.964625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b2b1571c-c129-4d02-83fb-7ce21b68abb2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33160>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:34.019697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b2b1571c-c129-4d02-83fb-7ce21b68abb2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059306 Aug 24 10:00:34.020344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1033/2051] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:33 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:35.034484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-051f3697-e816-4c38-ad8f-03cf0c1cec54 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:35.102999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-051f3697-e816-4c38-ad8f-03cf0c1cec54 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.072837 Aug 24 10:00:35.103604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1019/2052] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:35 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:36.116156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f2bbf3a2-c6ef-4885-bb9d-62d984de16da tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ef7f70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:36.160319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f2bbf3a2-c6ef-4885-bb9d-62d984de16da tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048307 Aug 24 10:00:36.160871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1034/2053] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:36 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:37.176186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3daf2abe-af4b-4567-b39c-abf61edc61dc tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:37.238914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3daf2abe-af4b-4567-b39c-abf61edc61dc tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.067937 Aug 24 10:00:37.239485 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1020/2054] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:37 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:38.253107 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cf6540e8-8402-4a83-b87b-ff4056cdb8c0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a160>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:38.312714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cf6540e8-8402-4a83-b87b-ff4056cdb8c0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063973 Aug 24 10:00:38.313275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1035/2055] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:38 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:39.326884 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ef6d00ae-e912-4f1c-926f-33c95c69042b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:39.379452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ef6d00ae-e912-4f1c-926f-33c95c69042b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056745 Aug 24 10:00:39.380071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1021/2056] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:39 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:40.393486 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-49c408d5-be38-42b1-821b-1d270865d31d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1ee0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:40.448525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-49c408d5-be38-42b1-821b-1d270865d31d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059274 Aug 24 10:00:40.449104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1036/2057] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:40 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:41.464874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9c93ed09-9486-408b-8263-552f67cb2633 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707b80>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:41.523429 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9c93ed09-9486-408b-8263-552f67cb2633 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063356 Aug 24 10:00:41.524103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1022/2058] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:41 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:42.538225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f5e08b4c-a492-410e-83a0-bd2ee09c219f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6eda60>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:42.591999 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f5e08b4c-a492-410e-83a0-bd2ee09c219f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.057843 Aug 24 10:00:42.592553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1037/2059] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:42 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:43.606697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-171a35c3-70ad-4202-b59e-7603221f4546 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68dee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:43.672894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-171a35c3-70ad-4202-b59e-7603221f4546 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.070907 Aug 24 10:00:43.673459 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1023/2060] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:43 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:44.688597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-352c82f2-cd61-4a18-9f86-2adc52b78acb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f4d670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:44.735005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-352c82f2-cd61-4a18-9f86-2adc52b78acb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051865 Aug 24 10:00:44.735560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1038/2061] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:44 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:45.748867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-97ecb091-2320-4d17-abc3-246edb8a3109 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27ee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:45.802213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-97ecb091-2320-4d17-abc3-246edb8a3109 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.057564 Aug 24 10:00:45.802783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1024/2062] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:45 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:46.815332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b338de64-4374-4120-98be-2b1fb1006bd7 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33160>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:46.884950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b338de64-4374-4120-98be-2b1fb1006bd7 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.073727 Aug 24 10:00:46.885604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1039/2063] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:46 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:47.898582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f8d96b2e-45e0-4277-bc7e-66bed12f52f1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68dee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:47.943921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f8d96b2e-45e0-4277-bc7e-66bed12f52f1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049631 Aug 24 10:00:47.944486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1025/2064] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:47 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:48.958810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fe20c4e6-0379-4ed7-9f7a-75d838f3398e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa9182a6a60>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:49.015399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fe20c4e6-0379-4ed7-9f7a-75d838f3398e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061170 Aug 24 10:00:49.016003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1040/2065] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:48 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:50.029196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b925ea29-7e31-4b15-bcd4-67ec92e6e5ed tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e5ff70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:50.084463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b925ea29-7e31-4b15-bcd4-67ec92e6e5ed tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059389 Aug 24 10:00:50.085027 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1026/2066] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:50 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:51.098408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0947493f-fd8a-426f-a841-1dda901c2e7e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33f70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:51.155133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0947493f-fd8a-426f-a841-1dda901c2e7e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061101 Aug 24 10:00:51.155883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1041/2067] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:51 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:52.168347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68846c61-3ad1-4222-853c-47a0de7c0b24 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2d790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:52.234194 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68846c61-3ad1-4222-853c-47a0de7c0b24 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.070304 Aug 24 10:00:52.234768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1027/2068] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:52 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:53.247678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-60d6ef91-e1a0-474d-86de-93be395d2245 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f4d430>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:53.298822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-60d6ef91-e1a0-474d-86de-93be395d2245 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.055403 Aug 24 10:00:53.303311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1042/2069] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:53 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:54.312767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0631c80e-793f-452c-93bf-8e05a7f2c29b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:54.372894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0631c80e-793f-452c-93bf-8e05a7f2c29b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.064254 Aug 24 10:00:54.373460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1028/2070] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:54 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:55.387954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ffa7805d-a1b8-4f16-841f-e05b85567ba8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f63670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:55.446060 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ffa7805d-a1b8-4f16-841f-e05b85567ba8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063653 Aug 24 10:00:55.446623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1043/2071] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:55 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:56.460900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4bea7fa6-8055-483e-921e-3586a89700a6 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d1af70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:56.512606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4bea7fa6-8055-483e-921e-3586a89700a6 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056079 Aug 24 10:00:56.513175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1029/2072] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:56 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:57.525355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5f0928a0-14d5-4d2e-8ca0-101fbbdc97d2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d48310>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:57.578405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5f0928a0-14d5-4d2e-8ca0-101fbbdc97d2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056640 Aug 24 10:00:57.578965 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1044/2073] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:57 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:58.592634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e3b09994-5f9a-439c-96ca-265d8af441aa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2dee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:58.649585 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e3b09994-5f9a-439c-96ca-265d8af441aa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061240 Aug 24 10:00:58.650150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1030/2074] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:58 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:00:59.663533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-deacc3c4-1a10-4873-add5-d77a21379d18 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33f70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:00:59.721714 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-deacc3c4-1a10-4873-add5-d77a21379d18 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062471 Aug 24 10:00:59.722288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1045/2075] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:00:59 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:00.736119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b7560e03-a863-42f4-bc13-4f94025f00d2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8fb80>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:00.789756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b7560e03-a863-42f4-bc13-4f94025f00d2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058183 Aug 24 10:01:00.790381 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1031/2076] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:00 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:01.809733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a3e378a1-5883-4f1f-a0a9-0697a19b506c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912da70d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:01.860730 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a3e378a1-5883-4f1f-a0a9-0697a19b506c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.055238 Aug 24 10:01:01.861297 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1046/2077] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:01 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:02.874993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4ec539f7-d464-4178-94f3-64e14362f56e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e5ff70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:02.930608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4ec539f7-d464-4178-94f3-64e14362f56e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059794 Aug 24 10:01:02.931170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1032/2078] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:02 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:03.945075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5e2f90e5-d02f-4875-ae7e-800acb93cb60 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6ed8b0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:03.999383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5e2f90e5-d02f-4875-ae7e-800acb93cb60 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058475 Aug 24 10:01:03.999961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1047/2079] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:03 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:05.013234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dddd7360-0ffb-499c-9b53-d5e5d5528855 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69df70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:05.076601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dddd7360-0ffb-499c-9b53-d5e5d5528855 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.067068 Aug 24 10:01:05.077179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1033/2080] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:05 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:06.090504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-de15296e-4ee5-4cfa-b443-09f4b2645851 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f4d700>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:06.139835 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-de15296e-4ee5-4cfa-b443-09f4b2645851 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.053443 Aug 24 10:01:06.140394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1048/2081] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:06 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:07.153613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-70b49038-623d-49d8-b6d0-811d363ebb11 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69db80>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:07.211992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-70b49038-623d-49d8-b6d0-811d363ebb11 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062589 Aug 24 10:01:07.219298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1034/2082] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:07 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:08.231532 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9ece8506-8603-422f-9a2e-fb8b9f28be80 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8cca0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:08.293321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9ece8506-8603-422f-9a2e-fb8b9f28be80 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059578 Aug 24 10:01:08.293321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1049/2083] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:08 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:09.302056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-422e29e8-669d-4905-9c54-ebaf2704290d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:09.376426 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-422e29e8-669d-4905-9c54-ebaf2704290d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.079922 Aug 24 10:01:09.376987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1035/2084] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:09 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:10.390816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2d494b01-11eb-495b-b3ad-53dffcb4affa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a8b0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:10.578602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2d494b01-11eb-495b-b3ad-53dffcb4affa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.192316 Aug 24 10:01:10.579172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1050/2085] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:10 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:11.593825 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2be65f7b-8085-4588-9bcb-216260ea5385 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e47f70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:11.639201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2be65f7b-8085-4588-9bcb-216260ea5385 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.050545 Aug 24 10:01:11.639802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1036/2086] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:11 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:12.653707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-503a1c1b-89c0-48a6-b8b1-000e213978d8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e338b0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:12.698959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-503a1c1b-89c0-48a6-b8b1-000e213978d8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049949 Aug 24 10:01:12.699641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1051/2087] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:12 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:13.712278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a103a2d-bd0e-4ebb-9930-154d4a5aa1c0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68dd30>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:13.759397 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3a103a2d-bd0e-4ebb-9930-154d4a5aa1c0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051331 Aug 24 10:01:13.760048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1037/2088] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:13 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:14.773457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2e0d4af9-99c2-4453-8c79-b4a63c223467 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3430>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:14.819075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2e0d4af9-99c2-4453-8c79-b4a63c223467 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049782 Aug 24 10:01:14.819678 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1052/2089] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:14 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:15.833186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e703c02e-faa6-4a88-88e9-d337869bee78 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69d310>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:15.880823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e703c02e-faa6-4a88-88e9-d337869bee78 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052111 Aug 24 10:01:15.881490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1038/2090] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:15 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:16.895239 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6789c7d9-7cc8-47fa-bed6-98f50f76ccdb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33550>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:16.941832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6789c7d9-7cc8-47fa-bed6-98f50f76ccdb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.050768 Aug 24 10:01:16.942482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1053/2091] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:16 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:17.955967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c676fb66-eda1-416f-8608-89a5a0236fcb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707e50>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:18.001275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c676fb66-eda1-416f-8608-89a5a0236fcb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049817 Aug 24 10:01:18.001853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1039/2092] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:17 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:19.015544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f10b1a46-0c02-456c-95d5-b442a981b5ff tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f4d310>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:19.060892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f10b1a46-0c02-456c-95d5-b442a981b5ff tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049533 Aug 24 10:01:19.061448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1054/2093] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:19 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:20.075343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-db22cf7e-266f-4a15-a53c-654e2cde85b3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69d160>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:20.120140 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-db22cf7e-266f-4a15-a53c-654e2cde85b3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049732 Aug 24 10:01:20.120777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1040/2094] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:20 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:21.134966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-161e2b45-6384-4f51-a1fa-1a8d95e44253 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3550>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:21.181743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-161e2b45-6384-4f51-a1fa-1a8d95e44253 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051315 Aug 24 10:01:21.182321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1055/2095] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:21 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:21.488240 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:01:21.488434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:01:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:01:22.195868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-477b64cc-3912-4537-9ea1-ba2de6584846 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68dee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:22.246623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-477b64cc-3912-4537-9ea1-ba2de6584846 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049818 Aug 24 10:01:22.246623 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1041/2096] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:22 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:23.256598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-05ec1b0a-8407-4a9a-aeac-32d83ac1e0ad tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f1adc0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:23.304608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-05ec1b0a-8407-4a9a-aeac-32d83ac1e0ad tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052325 Aug 24 10:01:23.305164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1056/2097] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:23 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:24.318856 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-75425233-56c4-4627-95ef-adf7c74851fa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecd700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:24.377599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-75425233-56c4-4627-95ef-adf7c74851fa tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062974 Aug 24 10:01:24.378160 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1042/2098] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:24 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:25.391207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fd54b520-0972-4925-9176-1d08760f7d0f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8c5e0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:25.445789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fd54b520-0972-4925-9176-1d08760f7d0f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058679 Aug 24 10:01:25.446348 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1057/2099] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:25 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:26.458407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-07147904-c287-4e6c-8423-a99257e8bdf5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91814df70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:26.525006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-07147904-c287-4e6c-8423-a99257e8bdf5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.070009 Aug 24 10:01:26.525571 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1043/2100] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:26 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:27.539009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c900f1a2-9a52-4abe-9674-f248a3c3bc2e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9ac10>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:27.605917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c900f1a2-9a52-4abe-9674-f248a3c3bc2e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.071234 Aug 24 10:01:27.606465 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1058/2101] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:27 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:28.619561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-70765781-5b13-4cf7-bb30-1e42460de755 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:28.687612 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-70765781-5b13-4cf7-bb30-1e42460de755 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.072462 Aug 24 10:01:28.688183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1044/2102] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:28 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:01:29.702164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-99cbd0a2-7e2b-49fb-b431-05e328b39cba tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3040>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:29.760799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-99cbd0a2-7e2b-49fb-b431-05e328b39cba tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062820 Aug 24 10:01:29.761369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1059/2103] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:29 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:30.107634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:01:30.108224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:01:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:01:30.778405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-961ee5f0-6146-4898-a7fa-96c5e6379d29 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ce8040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:30.854082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-961ee5f0-6146-4898-a7fa-96c5e6379d29 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.079628 Aug 24 10:01:30.854924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1045/2104] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:30 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:30.987221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:01:30.987770 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:01:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:01:31.870134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1a2e0fcb-2286-4789-9b8b-6964addc8d6c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a0d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:31.919247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1a2e0fcb-2286-4789-9b8b-6964addc8d6c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.050855 Aug 24 10:01:31.919247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1060/2105] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:31 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:32.930406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4895229d-59fb-4011-91b0-69e29dc9d16e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d8b0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:32.974947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4895229d-59fb-4011-91b0-69e29dc9d16e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048707 Aug 24 10:01:32.975667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1046/2106] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:32 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:33.988954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-99994d0e-120c-4df7-9572-6e36fb7d399b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb39d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:34.044236 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-99994d0e-120c-4df7-9572-6e36fb7d399b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059607 Aug 24 10:01:34.044809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1061/2107] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:33 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:35.058380 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6e257848-63d8-47d5-a50f-ac87eb0a4c05 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91814df70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:35.119338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6e257848-63d8-47d5-a50f-ac87eb0a4c05 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.065225 Aug 24 10:01:35.119963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1047/2108] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:35 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:36.132357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e4c014a0-d46c-42cc-81e5-21f4a4e9cc4c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8c700>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:36.188702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e4c014a0-d46c-42cc-81e5-21f4a4e9cc4c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.060644 Aug 24 10:01:36.189250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1062/2109] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:36 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:37.202291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-32b721d6-31e9-4a3d-ad31-76324b78a6d3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2dca0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:37.254447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-32b721d6-31e9-4a3d-ad31-76324b78a6d3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056242 Aug 24 10:01:37.255012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1048/2110] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:37 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:38.275776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a6f8d396-c0da-4f6c-85a3-6821b3838e56 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912da7040>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:38.339265 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a6f8d396-c0da-4f6c-85a3-6821b3838e56 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.075685 Aug 24 10:01:38.339890 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1063/2111] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:38 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:39.353940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5244a57b-da80-40ca-81f7-1839152dfe7b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecdd30>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:39.404718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5244a57b-da80-40ca-81f7-1839152dfe7b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.055708 Aug 24 10:01:39.405302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1049/2112] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:39 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:40.419093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4aadbd5b-3f3d-47d9-b9fd-63cded6155d8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8c0d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:40.474471 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4aadbd5b-3f3d-47d9-b9fd-63cded6155d8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.060166 Aug 24 10:01:40.475020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1064/2113] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:40 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:41.489536 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-66fac587-620a-483e-8ae5-b72ce2ba27d2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:41.550480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-66fac587-620a-483e-8ae5-b72ce2ba27d2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.066315 Aug 24 10:01:41.551145 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1050/2114] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:41 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:42.565212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6b6a7112-3448-460c-ba18-ad1315f79d72 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3040>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:42.614681 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6b6a7112-3448-460c-ba18-ad1315f79d72 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.053935 Aug 24 10:01:42.615233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1065/2115] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:42 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:43.629182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-300a8768-1759-48d1-a301-ed187c4e8467 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2d5e0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:43.689720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-300a8768-1759-48d1-a301-ed187c4e8467 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.064815 Aug 24 10:01:43.690285 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1051/2116] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:43 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:44.704405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-92ccebdd-1b28-4cbb-a5d2-1bf01def22da tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a0d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:44.756691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-92ccebdd-1b28-4cbb-a5d2-1bf01def22da tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056426 Aug 24 10:01:44.757301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1066/2117] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:44 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:45.770640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-59fc9f0c-d7a6-408c-ab4e-ac8743096445 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d160>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:45.829238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-59fc9f0c-d7a6-408c-ab4e-ac8743096445 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062740 Aug 24 10:01:45.830072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1052/2118] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:45 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:46.843301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9584b702-dda4-4479-bbff-4c8d5f88ce3a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a820>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:46.908876 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9584b702-dda4-4479-bbff-4c8d5f88ce3a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.069501 Aug 24 10:01:46.909444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1067/2119] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:46 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:47.922778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-54ee8d5b-b2a6-4d12-9235-1a99dc366357 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2e4c0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:47.981419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-54ee8d5b-b2a6-4d12-9235-1a99dc366357 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062760 Aug 24 10:01:47.981982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1053/2120] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:47 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:01:48.995049 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1132d172-a8dc-45ba-8ace-0cc97f566ce3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8cdc0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:49.045084 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1132d172-a8dc-45ba-8ace-0cc97f566ce3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.054817 Aug 24 10:01:49.045639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1068/2121] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:48 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:50.059239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-adb4f1fb-717a-4fb8-9089-679c6c137781 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2daf0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:50.114072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-adb4f1fb-717a-4fb8-9089-679c6c137781 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059562 Aug 24 10:01:50.114634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1054/2122] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:50 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:51.128617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ad42c510-b3bd-41c5-ab1f-710225585fbb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6ed8b0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:51.195302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ad42c510-b3bd-41c5-ab1f-710225585fbb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.071041 Aug 24 10:01:51.195900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1069/2123] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:51 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:52.210341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-25a8cb8a-de91-4a93-ac7a-273f7daeee21 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecdee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:52.269342 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-25a8cb8a-de91-4a93-ac7a-273f7daeee21 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063331 Aug 24 10:01:52.275163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1055/2124] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:52 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:53.282583 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c54bbaf9-a5ff-431f-8f87-f580492d931b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb39d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:53.336194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c54bbaf9-a5ff-431f-8f87-f580492d931b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.057967 Aug 24 10:01:53.336765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1070/2125] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:53 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:54.350463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2575fd68-1b1a-4673-b15a-9a091436c305 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:54.406912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2575fd68-1b1a-4673-b15a-9a091436c305 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059174 Aug 24 10:01:54.406912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1056/2126] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:54 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:55.419759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6ab12c69-9911-4b58-90af-84763c175d45 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3ee0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:55.485584 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6ab12c69-9911-4b58-90af-84763c175d45 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.070038 Aug 24 10:01:55.486144 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1071/2127] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:55 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:56.498533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58b66988-9ae4-42dc-a5b8-43e2cd8fc7ab tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d1a160>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:56.550400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58b66988-9ae4-42dc-a5b8-43e2cd8fc7ab tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056141 Aug 24 10:01:56.550994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1057/2128] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:56 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:57.564500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-16aa4761-5342-43ce-b22a-4cc52e504b61 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa918c43280>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:57.624339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-16aa4761-5342-43ce-b22a-4cc52e504b61 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063978 Aug 24 10:01:57.624902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1072/2129] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:57 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:58.638747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-74107215-7fc9-41ef-b1ae-e404fcb6374f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b707160>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:58.693377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-74107215-7fc9-41ef-b1ae-e404fcb6374f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059418 Aug 24 10:01:58.693940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1058/2130] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:58 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:01:59.707984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3c795014-8538-4f9f-8bb8-65f3cfdb07a2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb35e0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:01:59.763513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3c795014-8538-4f9f-8bb8-65f3cfdb07a2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059916 Aug 24 10:01:59.764201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1073/2131] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:01:59 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:00.781860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a60149c2-8229-4f83-82ab-dc9b9dd980a1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2e4c0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:00.841758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a60149c2-8229-4f83-82ab-dc9b9dd980a1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.064148 Aug 24 10:02:00.842315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1059/2132] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:00 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:01.856316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c627ba1b-fa12-429d-a019-e3a13145c454 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8c700>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:01.911421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c627ba1b-fa12-429d-a019-e3a13145c454 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059381 Aug 24 10:02:01.912027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1074/2133] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:01 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:02.925635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-76651c28-42c3-49e3-abf5-5ae82e9d47b2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d1a8b0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:02.981737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-76651c28-42c3-49e3-abf5-5ae82e9d47b2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.060489 Aug 24 10:02:02.982325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1060/2134] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:02 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:03.995915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9d66ad34-c6df-494d-b0a9-ca2b45bafa10 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ef71f0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:04.057338 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9d66ad34-c6df-494d-b0a9-ca2b45bafa10 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.065773 Aug 24 10:02:04.057938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1075/2135] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:03 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:05.070795 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7d051127-6855-4903-87d7-d5505c3f8a1c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecd3a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:05.124151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7d051127-6855-4903-87d7-d5505c3f8a1c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.057775 Aug 24 10:02:05.124747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1061/2136] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:05 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:06.138562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2a996fb4-b1b1-4343-9d29-6220a96ff17a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa9181cb1f0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:06.202413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2a996fb4-b1b1-4343-9d29-6220a96ff17a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.068137 Aug 24 10:02:06.202970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1076/2137] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:06 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:07.216582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dba1a9bb-9923-4de0-8ac0-b14b529e8412 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24550>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:07.263831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dba1a9bb-9923-4de0-8ac0-b14b529e8412 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051889 Aug 24 10:02:07.264397 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1062/2138] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:07 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:08.277847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-de30f287-8916-44cd-be7e-3713f7e6f3c1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3dc0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:08.345683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-de30f287-8916-44cd-be7e-3713f7e6f3c1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.072199 Aug 24 10:02:08.346258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1077/2139] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:08 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:09.360157 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a665fb8a-a40b-47ba-b34a-ceb61dd9f94b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:09.407603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a665fb8a-a40b-47ba-b34a-ceb61dd9f94b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051619 Aug 24 10:02:09.408243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1063/2140] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:09 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:10.421561 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3e69737e-c488-4989-a629-cdb0fbf4374b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1ee0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:10.475909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3e69737e-c488-4989-a629-cdb0fbf4374b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058557 Aug 24 10:02:10.476478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1078/2141] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:10 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:11.489749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b0f068f0-932a-46c4-b92f-18110f1d2554 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6d08b0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:11.556150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b0f068f0-932a-46c4-b92f-18110f1d2554 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.070629 Aug 24 10:02:11.556714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1064/2142] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:11 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:12.569767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-787b7c85-9549-4d74-8633-fd1ba71f6981 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3a60>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:12.622332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-787b7c85-9549-4d74-8633-fd1ba71f6981 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056691 Aug 24 10:02:12.622886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1079/2143] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:12 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:13.636718 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1744b1f8-9926-43e4-ad9b-3cd1fa40e31c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2e820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:13.694776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1744b1f8-9926-43e4-ad9b-3cd1fa40e31c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058912 Aug 24 10:02:13.694776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1065/2144] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:13 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:14.706775 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d61192bc-b035-4bdd-a000-7f1e11e3e586 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8c1f0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:14.760983 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d61192bc-b035-4bdd-a000-7f1e11e3e586 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058751 Aug 24 10:02:14.761545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1080/2145] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:14 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:15.774522 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6f93cd07-dd41-47c1-84f6-1ae50cc76be6 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:15.840834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6f93cd07-dd41-47c1-84f6-1ae50cc76be6 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.070585 Aug 24 10:02:15.841401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1066/2146] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:15 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:16.854698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-579a141a-3fc8-4807-9588-ca4106e22be8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd19d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:16.918802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-579a141a-3fc8-4807-9588-ca4106e22be8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.068389 Aug 24 10:02:16.919437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1081/2147] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:16 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:17.933526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fcfd6830-2768-4bc8-bc4b-69de2a6c3111 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecd3a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:17.977667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fcfd6830-2768-4bc8-bc4b-69de2a6c3111 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048881 Aug 24 10:02:17.978256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1067/2148] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:17 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:18.990758 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-36aecb0a-ccd0-4afc-9e38-352ae9d0384f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa9181cb430>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:19.045246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-36aecb0a-ccd0-4afc-9e38-352ae9d0384f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058657 Aug 24 10:02:19.045804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1082/2149] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:18 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:20.058906 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cda6a9b6-a709-479f-b606-577e0f2e908a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24310>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:20.116201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cda6a9b6-a709-479f-b606-577e0f2e908a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061962 Aug 24 10:02:20.116771 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1068/2150] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:20 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:21.129919 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-34ed724e-94df-4455-b20f-cc1a1cacf3d8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3a60>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:21.186525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-34ed724e-94df-4455-b20f-cc1a1cacf3d8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.060697 Aug 24 10:02:21.187075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1083/2151] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:21 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:22.201133 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b6ca04df-355f-4923-810e-ba44ef5e4f43 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27ee0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:22.273446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b6ca04df-355f-4923-810e-ba44ef5e4f43 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.077657 Aug 24 10:02:22.274022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1069/2152] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:22 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:23.287496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f2210c92-0007-42d8-a05d-a376aa3b6a2d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810b790>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:23.335023 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f2210c92-0007-42d8-a05d-a376aa3b6a2d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051725 Aug 24 10:02:23.335595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1084/2153] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:23 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:24.349627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a9c9073e-6866-47ad-bc6c-af64d7b9771e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:24.404043 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a9c9073e-6866-47ad-bc6c-af64d7b9771e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058751 Aug 24 10:02:24.404607 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1070/2154] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:24 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:25.418226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-52f25a7f-4c75-4754-99f7-8cdf03ca831d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9ab80>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:25.479132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-52f25a7f-4c75-4754-99f7-8cdf03ca831d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.065246 Aug 24 10:02:25.479751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1085/2155] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:25 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:26.493045 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ac9f8ac8-e9d3-4361-9a44-9b6fd942ef6d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecd700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:26.567070 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ac9f8ac8-e9d3-4361-9a44-9b6fd942ef6d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.078209 Aug 24 10:02:26.567657 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1071/2156] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:26 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:27.581926 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-133373f7-86bc-4674-a95b-498c6ded3192 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ef7c10>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:27.626871 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-133373f7-86bc-4674-a95b-498c6ded3192 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049495 Aug 24 10:02:27.627424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1086/2157] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:27 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:28.641763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eaf2ef1d-186f-4a50-a1f2-aa7b789801b8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69d280>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:28.694398 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eaf2ef1d-186f-4a50-a1f2-aa7b789801b8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.057005 Aug 24 10:02:28.694995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1072/2158] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:28 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:29.708097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f5c05674-9f46-42fa-8094-32c634fc295a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33940>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:29.768230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f5c05674-9f46-42fa-8094-32c634fc295a tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063993 Aug 24 10:02:29.768794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1087/2159] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:29 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:30.782642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e110dc6c-98c6-45ee-b5f0-d27aa492a7b1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f3ea60>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:30.841391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e110dc6c-98c6-45ee-b5f0-d27aa492a7b1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062904 Aug 24 10:02:30.842110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1073/2160] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:30 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:31.860392 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-882f9a3d-7b9c-4a0e-8c5d-f972e7d71390 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3430>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:31.905318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-882f9a3d-7b9c-4a0e-8c5d-f972e7d71390 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049100 Aug 24 10:02:31.905959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1088/2161] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:31 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:32.918821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b443057e-47a8-4732-849b-b06ecd055c98 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24b80>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:33.112351 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b443057e-47a8-4732-849b-b06ecd055c98 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.197822 Aug 24 10:02:33.112920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1074/2162] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:32 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:34.126199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7d5678d9-dbce-489e-a8f5-23dab85e4352 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e339d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:34.170604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7d5678d9-dbce-489e-a8f5-23dab85e4352 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048529 Aug 24 10:02:34.171150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1089/2163] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:34 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:35.185198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-222bd932-22f1-42d4-a721-8df04d93bd0c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69d430>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:35.229873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-222bd932-22f1-42d4-a721-8df04d93bd0c tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049722 Aug 24 10:02:35.230424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1075/2164] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:35 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:36.245347 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3066b8da-88ad-45d8-9865-a7cfd0dbc543 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91823cf70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:36.293194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3066b8da-88ad-45d8-9865-a7cfd0dbc543 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.053051 Aug 24 10:02:36.293724 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1090/2165] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:36 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:37.316051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5832d45c-d9cd-432a-9c33-62e5f963a910 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6d09d0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:37.360892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5832d45c-d9cd-432a-9c33-62e5f963a910 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049175 Aug 24 10:02:37.361452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1076/2166] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:37 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:38.377554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4dce2dd2-2a0d-40e8-81e5-ec1d991f1837 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810b4c0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:38.437960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4dce2dd2-2a0d-40e8-81e5-ec1d991f1837 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.062184 Aug 24 10:02:38.437960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1091/2167] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:38 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:39.449700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c028c27c-3cd7-41b9-9fe9-7f344a6ca0f1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f3e8b0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:39.498229 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c028c27c-3cd7-41b9-9fe9-7f344a6ca0f1 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052716 Aug 24 10:02:39.498781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1077/2168] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:39 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:40.511118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-725fde9f-f9b5-4327-9b95-1aa7aa92b53b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e9a670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:40.571720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-725fde9f-f9b5-4327-9b95-1aa7aa92b53b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.064687 Aug 24 10:02:40.572278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1092/2169] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:40 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:41.586743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-58da91bd-c3cc-48e8-a784-0b6d22e93100 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e47c10>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:41.646781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-58da91bd-c3cc-48e8-a784-0b6d22e93100 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.064338 Aug 24 10:02:41.647348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1078/2170] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:41 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:42.660606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-30df2b70-25ad-4130-af73-b1229774d880 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91823cc10>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:42.711620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-30df2b70-25ad-4130-af73-b1229774d880 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.055072 Aug 24 10:02:42.712181 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1093/2171] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:42 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:43.727213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c458b669-d8e3-47ac-9be2-08cba1f044c9 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ce8790>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:43.787277 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c458b669-d8e3-47ac-9be2-08cba1f044c9 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063942 Aug 24 10:02:43.787902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1079/2172] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:43 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:44.801415 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f428e255-bcf5-4460-ae6e-e010c12514c0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb39d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:44.855061 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f428e255-bcf5-4460-ae6e-e010c12514c0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.057768 Aug 24 10:02:44.856227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1094/2173] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:44 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:45.869637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ecfe808a-20e4-4d1f-ae6e-b0d5ac5c71c2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69dd30>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:45.928694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ecfe808a-20e4-4d1f-ae6e-b0d5ac5c71c2 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063446 Aug 24 10:02:45.929268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1080/2174] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:45 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:46.943550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-07c091b7-96e1-48f4-bee7-aa3946aa8c45 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33040>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:47.009537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-07c091b7-96e1-48f4-bee7-aa3946aa8c45 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.070307 Aug 24 10:02:47.010100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1095/2175] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:46 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:48.024118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-634504c1-5f3c-4d48-98b2-c9d76fa20104 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d8b0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:48.072131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-634504c1-5f3c-4d48-98b2-c9d76fa20104 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.052325 Aug 24 10:02:48.072697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1081/2176] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:48 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:49.086510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-45411b35-90c5-482d-ac7b-c16f0d49fd80 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912fed670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:49.140162 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-45411b35-90c5-482d-ac7b-c16f0d49fd80 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.057789 Aug 24 10:02:49.140729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1096/2177] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:49 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:50.154570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f9662407-4d6c-460b-998c-f542f015ec31 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6d09d0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:50.209128 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f9662407-4d6c-460b-998c-f542f015ec31 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059212 Aug 24 10:02:50.209699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1082/2178] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:50 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:51.223611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-62c92abd-9c71-4e6c-ba10-8b5bcd31ace8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa9181cb1f0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:51.284899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-62c92abd-9c71-4e6c-ba10-8b5bcd31ace8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.065472 Aug 24 10:02:51.285453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1097/2179] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:51 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:52.299973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3990f94a-12b1-4103-9cfd-559283e69965 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:52.358608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3990f94a-12b1-4103-9cfd-559283e69965 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.063707 Aug 24 10:02:52.359201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1083/2180] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:52 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:53.372551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d57d47ff-e408-40ef-8404-d30b0fdfb2ad tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810b790>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:53.423995 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d57d47ff-e408-40ef-8404-d30b0fdfb2ad tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.056192 Aug 24 10:02:53.424544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1098/2181] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:53 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:54.438339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-16e42f91-b28c-4e9f-aaee-dd69da6e88fb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d1a700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:54.502252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-16e42f91-b28c-4e9f-aaee-dd69da6e88fb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.068565 Aug 24 10:02:54.502913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1084/2182] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:54 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:55.515884 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ece78d54-621d-47f4-a477-1f55ec6f324f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1a60>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:55.566914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ece78d54-621d-47f4-a477-1f55ec6f324f tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.055383 Aug 24 10:02:55.567504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1099/2183] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:55 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:02:56.581362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f7b3dadf-3bd0-473d-ac35-a4c59ba99bb7 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d273a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:56.635483 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f7b3dadf-3bd0-473d-ac35-a4c59ba99bb7 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.058728 Aug 24 10:02:56.636127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1085/2184] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:56 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:57.649466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a7614b66-1f21-464c-b4df-f9a0e5ebf83b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91823ca60>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:57.713227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a7614b66-1f21-464c-b4df-f9a0e5ebf83b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.067998 Aug 24 10:02:57.713783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1100/2185] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:57 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:58.726400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1fe38ac4-7759-423b-8f56-f5772230bc03 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:58.781832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1fe38ac4-7759-423b-8f56-f5772230bc03 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.059118 Aug 24 10:02:58.782142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1086/2186] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:58 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:02:59.795121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-964795dd-efc6-4f97-b13f-f9bfbb86b7d3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f1a1f0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:02:59.851943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-964795dd-efc6-4f97-b13f-f9bfbb86b7d3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.061674 Aug 24 10:02:59.852513 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1101/2187] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:02:59 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:00.866390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-efc670e0-6276-4036-87a2-ac18347e3a53 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d1a040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:00.930827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-efc670e0-6276-4036-87a2-ac18347e3a53 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.068586 Aug 24 10:03:00.931532 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1087/2188] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:00 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:01.945414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c981bcf6-51f5-4102-8cc8-577ca7d0ffdb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912eb3160>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:02.110696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c981bcf6-51f5-4102-8cc8-577ca7d0ffdb tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.169906 Aug 24 10:03:02.111256 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1102/2189] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:01 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:03.124493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4249c600-fa71-4a74-9991-8eb57995ea8b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b69d940>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:03.169870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4249c600-fa71-4a74-9991-8eb57995ea8b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049526 Aug 24 10:03:03.170440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1088/2190] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:03 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:04.184339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7c21db8d-c7d2-477e-87e3-cd27c3d125b6 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1c10>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:04.227699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7c21db8d-c7d2-477e-87e3-cd27c3d125b6 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048184 Aug 24 10:03:04.228247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1103/2191] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:04 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:05.241823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ecfc4809-09fa-49c4-ac52-063242314faf tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:05.286525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ecfc4809-09fa-49c4-ac52-063242314faf tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048959 Aug 24 10:03:05.287089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1089/2192] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:05 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:06.300929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-13efdc04-927a-4d33-9078-2d5fff51d3d5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91823cf70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:06.349052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-13efdc04-927a-4d33-9078-2d5fff51d3d5 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051474 Aug 24 10:03:06.349052 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1104/2193] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:06 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:07.362736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ce4bf49b-9284-478b-bf6d-abb4313c9462 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2d1f0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:07.408276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ce4bf49b-9284-478b-bf6d-abb4313c9462 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.049956 Aug 24 10:03:07.408820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1090/2194] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:07 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:08.421973 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2a3136bf-8052-43a1-a2a3-e4dd22ff5231 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810bca0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:08.468367 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2a3136bf-8052-43a1-a2a3-e4dd22ff5231 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.050780 Aug 24 10:03:08.468921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1105/2195] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:08 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:08.525048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:03:08.525447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:03:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:03:09.481829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3c224f98-6275-4229-ac14-07acefd3a878 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e24ca0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:09.528203 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3c224f98-6275-4229-ac14-07acefd3a878 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.050533 Aug 24 10:03:09.528798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1091/2196] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:09 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:10.541881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-284a49f1-cb31-41d1-acc6-8bff32e5a301 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1820>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:10.585915 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-284a49f1-cb31-41d1-acc6-8bff32e5a301 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.048399 Aug 24 10:03:10.586490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1106/2197] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:10 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:11.596870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f358e20c-d175-4dda-9f6a-36271719efa4"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:03:11.600853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:11.601465 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3c4660fa-a83a-46f7-b4b4-eb6988ddb22b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912f1a5e0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:11.607880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:11.615138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:11.615138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:11.615138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:11.615138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:11.615706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:11.968409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3c4660fa-a83a-46f7-b4b4-eb6988ddb22b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.371978 Aug 24 10:03:11.974124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1107/2198] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:11 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:03:12.015537 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [043ee913-f0a4-4733-9de1-9cd950fd439c] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:03:12.982191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f2f4c7e1-4010-47d9-8c90-d928cae09045 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ef7790>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:13.024032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [043ee913-f0a4-4733-9de1-9cd950fd439c] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 39196. Aug 24 10:03:13.108761 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f2f4c7e1-4010-47d9-8c90-d928cae09045 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 345 microversion: 2.1 time: 0.130871 Aug 24 10:03:13.109454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1108/2199] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:12 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 345 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:03:13.121500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-420ab219-d122-4308-88dc-902a5e2b7301 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912f1a790>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:13.168376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-420ab219-d122-4308-88dc-902a5e2b7301 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/fe7df74e-cfaa-416c-9d0c-304025d6c28a" status: 200 len: 351 microversion: 2.1 time: 0.050467 Aug 24 10:03:13.168942 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1109/2200] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:13 2022] GET /compute/v2.1/os-volumes/fe7df74e-cfaa-416c-9d0c-304025d6c28a => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:13.173555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e43eaa44-0091-498d-b04b-383405f50b02 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Action: 'create', calling method: .version_select at 0x7fa912dd18b0>, body: {"snapshot": {"volume_id": "44e59a5b-c68e-4204-8015-bcaa824e17d3", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1906680233"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:03:13.731576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e43eaa44-0091-498d-b04b-383405f50b02 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.560306 Aug 24 10:03:13.733072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1110/2201] 10.222.0.16 () {60 vars in 1162 bytes} [Wed Aug 24 10:03:13 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:13.751355 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4d7dad43-e67a-410f-a216-66c0b68754a8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810b700>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:13.783963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4d7dad43-e67a-410f-a216-66c0b68754a8 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.041480 Aug 24 10:03:13.783963 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1111/2202] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:13 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:13.794628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fb630882-2fef-42d0-be42-3be8b993bc0d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e33040>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:13.826078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fb630882-2fef-42d0-be42-3be8b993bc0d tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035740 Aug 24 10:03:13.829785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1112/2203] 10.222.0.16 () {58 vars in 1140 bytes} [Wed Aug 24 10:03:13 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:13.837432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e10e313f-dab1-4909-ab83-97222fd6efcf tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd14c0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:13.868962 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e10e313f-dab1-4909-ab83-97222fd6efcf tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.035127 Aug 24 10:03:13.869528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1113/2204] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:13 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:03:14.198389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-71a41bf3-9f6a-480b-a816-e34b21eb12b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.607102 Aug 24 10:03:14.199912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1092/2205] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 10:03:11 2022] POST /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments => generated 194 bytes in 2609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:14.882229 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6389e4bb-6795-41e0-b629-5a667d1ce2ec tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ef7670>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:14.913104 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6389e4bb-6795-41e0-b629-5a667d1ce2ec tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.035139 Aug 24 10:03:14.913648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1114/2206] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:14 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:15.925829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-66740e60-76e9-4553-a9cf-c4f85b548565 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6d3700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:15.955857 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-66740e60-76e9-4553-a9cf-c4f85b548565 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.034502 Aug 24 10:03:15.956415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1093/2207] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:15 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:16.968718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5f311bd1-b3ab-4383-86e8-0c045b14ff86 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1700>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:16.997953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5f311bd1-b3ab-4383-86e8-0c045b14ff86 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.033986 Aug 24 10:03:16.998508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1115/2208] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:16 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:18.010820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fc5a3ca1-7a4f-4cce-ae99-3268e9752222 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912df0430>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:18.039802 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fc5a3ca1-7a4f-4cce-ae99-3268e9752222 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.033296 Aug 24 10:03:18.040391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1094/2209] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:18 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:19.052636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0c4ff29f-e5af-4dc2-bc0d-4dfd39fc9aa0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91810b4c0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:19.081745 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0c4ff29f-e5af-4dc2-bc0d-4dfd39fc9aa0 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.033508 Aug 24 10:03:19.083840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1116/2210] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:19 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:20.094952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-38a70397-8d05-4ce0-a53a-fc8ca3917fa4 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:20.123209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-38a70397-8d05-4ce0-a53a-fc8ca3917fa4 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.032957 Aug 24 10:03:20.123797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1095/2211] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:20 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:21.134980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5992d661-dd28-4e84-b0a5-2365b68eae94 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d7ca60>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:21.163931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5992d661-dd28-4e84-b0a5-2365b68eae94 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.033204 Aug 24 10:03:21.164473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1117/2212] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:21 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:22.174056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:22.177944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b3bad077-e6ae-4cb3-9d8d-786079e9bf61 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6d3820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:22.208562 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b3bad077-e6ae-4cb3-9d8d-786079e9bf61 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.035727 Aug 24 10:03:22.209209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1096/2213] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:22 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:23.221668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-9e1760fe-2c98-492e-a565-64a327a98611 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91823cc10>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:23.250647 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-9e1760fe-2c98-492e-a565-64a327a98611 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.033352 Aug 24 10:03:23.251206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1118/2214] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:23 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:24.259755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:03:24.264193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-031b816e-6e97-42f9-bab9-6c5dd8eac4ff tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d27430>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:24.297969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-031b816e-6e97-42f9-bab9-6c5dd8eac4ff tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.039335 Aug 24 10:03:24.298695 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1097/2215] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:24 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:25.310763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-14fe164b-367c-44de-82b0-87153ebbb0c3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd19d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:25.506827 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-14fe164b-367c-44de-82b0-87153ebbb0c3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.200382 Aug 24 10:03:25.507395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1119/2216] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:25 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:26.518425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-441d7b40-707a-44fa-99e7-86324bdd0d83 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2d820>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:26.558000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-441d7b40-707a-44fa-99e7-86324bdd0d83 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.043691 Aug 24 10:03:26.558554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1098/2217] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:26 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:27.570708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1aad2267-3fdd-4c8f-afbf-91583251cf46 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e8caf0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:27.620048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1aad2267-3fdd-4c8f-afbf-91583251cf46 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.053527 Aug 24 10:03:27.620617 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1120/2218] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:27 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:28.633539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0e424e16-0de3-420c-b2a0-b3f7c137454e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b68d700>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:28.673735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0e424e16-0de3-420c-b2a0-b3f7c137454e tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.044939 Aug 24 10:03:28.674300 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1099/2219] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:28 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:29.686811 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-30e6d665-6cf1-499b-94ac-fd87f901a770 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1f70>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:29.723137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-30e6d665-6cf1-499b-94ac-fd87f901a770 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 288 microversion: 2.1 time: 0.041581 Aug 24 10:03:29.723725 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1121/2220] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:29 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 288 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:29.735679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6c7d8ca7-6914-4680-9405-1c4cac36c951 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d2ef70>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:29.862785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6c7d8ca7-6914-4680-9405-1c4cac36c951 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "DELETE /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 202 len: 0 microversion: 2.1 time: 0.132038 Aug 24 10:03:29.863352 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1100/2221] 10.222.0.16 () {58 vars in 1254 bytes} [Wed Aug 24 10:03:29 2022] DELETE /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:03:29.871953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b1c99e4a-7d64-491a-b727-2a382586f41b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ef73a0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:29.900349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b1c99e4a-7d64-491a-b727-2a382586f41b tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.032585 Aug 24 10:03:29.900907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1122/2222] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:29 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:30.881694 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-43fb9097-bd68-4cc1-a930-5dab3c71a40a tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912d27e50>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:30.914574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-45364cbd-dfa9-4f47-bb6a-9fea0ce28e55 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91b6ed8b0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:30.965010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-43fb9097-bd68-4cc1-a930-5dab3c71a40a tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/ebe79db1-678d-476a-b29a-20ba9c7506f5" status: 200 len: 351 microversion: 2.1 time: 0.088621 Aug 24 10:03:30.965580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1101/2223] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:30 2022] GET /compute/v2.1/os-volumes/ebe79db1-678d-476a-b29a-20ba9c7506f5 => generated 351 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:30.987576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-45364cbd-dfa9-4f47-bb6a-9fea0ce28e55 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 200 len: 287 microversion: 2.1 time: 0.077195 Aug 24 10:03:30.988221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1123/2224] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:30 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 287 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:03:32.002212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e59508a5-6b92-44e0-ad92-a85766d4bd74 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912ecd3a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:32.070582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-e59508a5-6b92-44e0-ad92-a85766d4bd74 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] HTTP exception thrown: Snapshot 8c8e260d-05fc-45fe-a965-31c2bcb8b18c could not be found. Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e59508a5-6b92-44e0-ad92-a85766d4bd74 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Request method failure captured: Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c HTTP/1.1 Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfaLBbRupUtsah3BjyRYOJtPihBZgqalsHkyq8Z1qhCWZFop1TiWPnnvXeaEZ2JCjVWD1bmZRaOKW4PZWRb8C7DZ4NtTRlp_z0ZHeyee-4OBNNIIbV2gpJpyx5FdlxSPF-30aey2US6l28jSUaF8xJjjue1qOmYScmW5Dh_zh-H74Xw Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:03:32.074017 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c05e40a2edf473584e9cad9a3d52e7c", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: e70967fd97d2481195c504c5d06a0b20 Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Snapshot 8c8e260d-05fc-45fe-a965-31c2bcb8b18c could not be found. Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '8c8e260d-05fc-45fe-a965-31c2bcb8b18c'} Aug 24 10:03:32.075399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8c8e260d-05fc-45fe-a965-31c2bcb8b18c could not be found. (HTTP 404) (Request-ID: req-09cb26d1-2fed-4972-ba0e-38f75cce1c08) Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:32.081528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:03:32.082560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8c8e260d-05fc-45fe-a965-31c2bcb8b18c could not be found. Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 24 10:03:32.083636 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8c8e260d-05fc-45fe-a965-31c2bcb8b18c could not be found. Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8c8e260d-05fc-45fe-a965-31c2bcb8b18c could not be found. Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e59508a5-6b92-44e0-ad92-a85766d4bd74 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Returning 404 to user: Snapshot 8c8e260d-05fc-45fe-a965-31c2bcb8b18c could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:03:32.084733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e59508a5-6b92-44e0-ad92-a85766d4bd74 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c" status: 404 len: 111 microversion: 2.1 time: 0.078073 Aug 24 10:03:32.085441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1102/2225] 10.222.0.16 () {58 vars in 1251 bytes} [Wed Aug 24 10:03:31 2022] GET /compute/v2.1/os-snapshots/8c8e260d-05fc-45fe-a965-31c2bcb8b18c => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:03:32.088952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f1c6af44-9514-495b-be2e-72bb1ce22d72 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa91823c430>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:32.325669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f1c6af44-9514-495b-be2e-72bb1ce22d72 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 202 len: 0 microversion: 2.1 time: 0.240748 Aug 24 10:03:32.326763 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1124/2226] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 10:03:32 2022] DELETE /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:03:32.335441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-980a2f9d-9603-4346-9473-6d6a7f1d7070 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912d273a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:32.385999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-980a2f9d-9603-4346-9473-6d6a7f1d7070 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.054348 Aug 24 10:03:32.386637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1103/2227] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:32 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:33.400907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-812cf919-7b3e-4956-a5ad-dad70aac5cb4 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912dd1310>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:33.448727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-812cf919-7b3e-4956-a5ad-dad70aac5cb4 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 200 len: 344 microversion: 2.1 time: 0.051473 Aug 24 10:03:33.449293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1125/2228] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:33 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:33.902770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1b0182a3-467b-4606-b8c5-3095a10191db tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa91b6d09d0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:33.953594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1b0182a3-467b-4606-b8c5-3095a10191db tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/f0bf61bf-0237-47d4-b3b9-d453e46e0490" status: 200 len: 350 microversion: 2.1 time: 0.055688 Aug 24 10:03:33.954511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1104/2229] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:33 2022] GET /compute/v2.1/os-volumes/f0bf61bf-0237-47d4-b3b9-d453e46e0490 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:33.966785 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d60a430f-154e-4b00-b13f-b0b31f691dc3 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912e9a0d0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.052105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d60a430f-154e-4b00-b13f-b0b31f691dc3 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089046 Aug 24 10:03:34.052787 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1126/2230] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Aug 24 10:03:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:03:34.066262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3045978a-3a7d-4ac9-af89-cc795857e8ef tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912d27430>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.149956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3045978a-3a7d-4ac9-af89-cc795857e8ef tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087451 Aug 24 10:03:34.150689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1105/2231] 10.222.0.16 () {58 vars in 1149 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:34.164810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f2fd5b41-dc14-4c90-91da-4dd823a1a766 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912da73a0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.248374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f2fd5b41-dc14-4c90-91da-4dd823a1a766 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087418 Aug 24 10:03:34.252738 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1127/2232] 10.222.0.16 () {58 vars in 1134 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:34.264739 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6d3f1109-f2b8-45d4-ad45-36f214090176 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912d2d4c0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.364449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6d3f1109-f2b8-45d4-ad45-36f214090176 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103743 Aug 24 10:03:34.365436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1106/2233] 10.222.0.16 () {58 vars in 1167 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:34.379078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-947286da-269b-4c37-b377-0e6f44d6831d tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912dd1310>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.462820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-947286da-269b-4c37-b377-0e6f44d6831d tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087457 Aug 24 10:03:34.463387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77700935-4892-4a1b-ab92-5dd6e9f3fac3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e5f3a0>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.463474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1128/2234] 10.222.0.16 () {58 vars in 1170 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:34.476544 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-44da86d7-e51e-472b-af6f-d698648092a7 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912ef7310>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.492457 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-77700935-4892-4a1b-ab92-5dd6e9f3fac3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] HTTP exception thrown: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77700935-4892-4a1b-ab92-5dd6e9f3fac3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Request method failure captured: Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 HTTP/1.1 Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfaLBbRupUtsah3BjyRYOJtPihBZgqalsHkyq8Z1qhCWZFop1TiWPnnvXeaEZ2JCjVWD1bmZRaOKW4PZWRb8C7DZ4NtTRlp_z0ZHeyee-4OBNNIIbV2gpJpyx5FdlxSPF-30aey2US6l28jSUaF8xJjjue1qOmYScmW5Dh_zh-H74Xw Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:03:34.494526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c05e40a2edf473584e9cad9a3d52e7c", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: e70967fd97d2481195c504c5d06a0b20 Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '44e59a5b-c68e-4204-8015-bcaa824e17d3'} Aug 24 10:03:34.498849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. (HTTP 404) (Request-ID: req-68e7571f-f381-462a-ad1f-b99266acdb8f) Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.499920 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:03:34.500945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:03:34.502006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-77700935-4892-4a1b-ab92-5dd6e9f3fac3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Returning 404 to user: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-77700935-4892-4a1b-ab92-5dd6e9f3fac3 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 404 len: 109 microversion: 2.1 time: 0.036627 Aug 24 10:03:34.502967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1107/2235] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:03:34.539698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5af04452-b73c-4b56-abd9-36e77ec3b143 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e47a60>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.573301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-44da86d7-e51e-472b-af6f-d698648092a7 tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100299 Aug 24 10:03:34.573872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1129/2236] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:03:34.587669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-93dbc6d2-596e-4164-9c46-283c3d2e456c tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912e9a280>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.594779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-5af04452-b73c-4b56-abd9-36e77ec3b143 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] HTTP exception thrown: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5af04452-b73c-4b56-abd9-36e77ec3b143 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Request method failure captured: Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 HTTP/1.1 Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfaLBbRupUtsah3BjyRYOJtPihBZgqalsHkyq8Z1qhCWZFop1TiWPnnvXeaEZ2JCjVWD1bmZRaOKW4PZWRb8C7DZ4NtTRlp_z0ZHeyee-4OBNNIIbV2gpJpyx5FdlxSPF-30aey2US6l28jSUaF8xJjjue1qOmYScmW5Dh_zh-H74Xw Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:03:34.597003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c05e40a2edf473584e9cad9a3d52e7c", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: e70967fd97d2481195c504c5d06a0b20 Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '44e59a5b-c68e-4204-8015-bcaa824e17d3'} Aug 24 10:03:34.602390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. (HTTP 404) (Request-ID: req-8eda4d8a-5aee-4375-ac80-38f678138d9f) Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.603370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 24 10:03:34.604512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 24 10:03:34.605544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5af04452-b73c-4b56-abd9-36e77ec3b143 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Returning 404 to user: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:03:34.606543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5af04452-b73c-4b56-abd9-36e77ec3b143 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "DELETE /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 404 len: 109 microversion: 2.1 time: 0.065910 Aug 24 10:03:34.607250 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1108/2237] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 10:03:34 2022] DELETE /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:03:34.607910 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2e79adf2-29d9-4e94-b8b5-aef59f5b4b41 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Calling method '.version_select at 0x7fa912e47e50>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.683209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-93dbc6d2-596e-4164-9c46-283c3d2e456c tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099092 Aug 24 10:03:34.683806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1130/2238] 10.222.0.16 () {58 vars in 1188 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:34.696620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a35cc313-ffc0-43d6-a5c3-7ba1e48b50fd tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] Calling method '.version_select at 0x7fa912fed4c0>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:34.704871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-2e79adf2-29d9-4e94-b8b5-aef59f5b4b41 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] HTTP exception thrown: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2e79adf2-29d9-4e94-b8b5-aef59f5b4b41 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Request method failure captured: Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 HTTP/1.1 Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfaLBbRupUtsah3BjyRYOJtPihBZgqalsHkyq8Z1qhCWZFop1TiWPnnvXeaEZ2JCjVWD1bmZRaOKW4PZWRb8C7DZ4NtTRlp_z0ZHeyee-4OBNNIIbV2gpJpyx5FdlxSPF-30aey2US6l28jSUaF8xJjjue1qOmYScmW5Dh_zh-H74Xw Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:03:34.707682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/9c05e40a2edf473584e9cad9a3d52e7c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_9c05e40a2edf473584e9cad9a3d52e7c", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 9c05e40a2edf473584e9cad9a3d52e7c Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1067499269 Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: e70967fd97d2481195c504c5d06a0b20 Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1067499269-project Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '44e59a5b-c68e-4204-8015-bcaa824e17d3'} Aug 24 10:03:34.712477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. (HTTP 404) (Request-ID: req-727acae8-c3ac-46c2-b823-d85a87543477) Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.713837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 24 10:03:34.715745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 24 10:03:34.717000 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2e79adf2-29d9-4e94-b8b5-aef59f5b4b41 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] Returning 404 to user: Volume 44e59a5b-c68e-4204-8015-bcaa824e17d3 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2e79adf2-29d9-4e94-b8b5-aef59f5b4b41 tempest-VolumesSnapshotsTestJSON-1067499269 tempest-VolumesSnapshotsTestJSON-1067499269-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3" status: 404 len: 109 microversion: 2.1 time: 0.105600 Aug 24 10:03:34.719325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1109/2239] 10.222.0.16 () {58 vars in 1245 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes/44e59a5b-c68e-4204-8015-bcaa824e17d3 => generated 109 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:03:34.783170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a35cc313-ffc0-43d6-a5c3-7ba1e48b50fd tempest-VolumesTestJSON-1205993948 tempest-VolumesTestJSON-1205993948-project] 10.222.0.16 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090273 Aug 24 10:03:34.783779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1131/2240] 10.222.0.16 () {58 vars in 1155 bytes} [Wed Aug 24 10:03:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:03:40.913408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:03:40.914013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:03:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:03:44.517552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f358e20c-d175-4dda-9f6a-36271719efa4"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:03:44.519972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:44.526682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:44.527167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:44.527634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:44.528323 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:44.528783 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:44.529209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:44.607108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Invalid volume: volume f358e20c-d175-4dda-9f6a-36271719efa4 is already attached to instances: 9f835766-0103-492d-86a7-f3b9f896c37b Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: POST /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments HTTP/1.1 Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 74 Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:03:44.608745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {"volumeAttachment": {"volumeId": "f358e20c-d175-4dda-9f6a-36271719efa4"}} Aug 24 10:03:44.610635 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Invalid volume: volume f358e20c-d175-4dda-9f6a-36271719efa4 is already attached to instances: 9f835766-0103-492d-86a7-f3b9f896c37b Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'server_id': '9f835766-0103-492d-86a7-f3b9f896c37b', 'body': {'volumeAttachment': {'volumeId': 'f358e20c-d175-4dda-9f6a-36271719efa4'}}} Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f358e20c-d175-4dda-9f6a-36271719efa4 is already attached to instances: 9f835766-0103-492d-86a7-f3b9f896c37b Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:44.611375 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f358e20c-d175-4dda-9f6a-36271719efa4 is already attached to instances: 9f835766-0103-492d-86a7-f3b9f896c37b Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:44.612853 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f358e20c-d175-4dda-9f6a-36271719efa4 is already attached to instances: 9f835766-0103-492d-86a7-f3b9f896c37b Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 400 to user: Invalid volume: volume f358e20c-d175-4dda-9f6a-36271719efa4 is already attached to instances: 9f835766-0103-492d-86a7-f3b9f896c37b {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-346b3162-ec52-47d7-8056-20e4c2d6da15 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097818 Aug 24 10:03:44.614753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1110/2241] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 10:03:44 2022] POST /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 24 10:03:44.674434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:44.674934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:44.680794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:44.681267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:44.681695 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:44.682377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:44.682824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:44.683489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:44.804600 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lazy-loading 'services' on Instance uuid 9f835766-0103-492d-86a7-f3b9f896c37b {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:03:45.066897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cbc4cc16-e982-4e20-a28a-008531b6320f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments/f358e20c-d175-4dda-9f6a-36271719efa4" status: 202 len: 0 microversion: 2.1 time: 0.397653 Aug 24 10:03:45.067483 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1132/2242] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Aug 24 10:03:44 2022] DELETE /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments/f358e20c-d175-4dda-9f6a-36271719efa4 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:03:45.076997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:45.080200 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:45.086864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:45.087344 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:45.087817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:45.088544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:45.088997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:45.089415 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:45.118422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-96cae2c2-fdda-4bae-b768-9507c9831f92 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046497 Aug 24 10:03:45.118897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1111/2243] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:03:45 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:46.132047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:46.134782 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:46.141073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:46.141635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:46.142219 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:46.143150 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:46.143727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:46.144217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:46.175608 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-29a859fe-4c56-4d92-b767-50be3dfc66b4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048581 Aug 24 10:03:46.176200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1133/2244] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:03:46 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:47.189127 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.191399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:47.198420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:47.199150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:47.199673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:47.200692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:47.201198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:47.201854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:47.233282 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1de9c10f-cf18-4566-9094-8504c3a092e0 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049256 Aug 24 10:03:47.233835 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1112/2245] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:03:47 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:03:47.293382 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.293950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:47.300743 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:47.301230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:47.301679 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:47.302377 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:47.302836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:47.303270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:47.333771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:03:47.649106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e2538d37-8d70-4f58-b03a-0764d4d75554 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 204 len: 0 microversion: 2.1 time: 0.359299 Aug 24 10:03:47.649764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1134/2246] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:03:47 2022] DELETE /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:03:47.664121 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:47.664788 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:47.670634 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:47.671096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:47.671662 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:47.672371 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:47.672822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:47.673257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:47.812149 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:03:47.820024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6e2e1634-64a1-46eb-9f64-4dc5e5739a4d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1682 microversion: 2.1 time: 0.159620 Aug 24 10:03:47.820587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1113/2247] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:47 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:48.842127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:48.842830 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:48.850141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:48.850627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:48.851174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:48.852164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:48.853245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:48.854006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:49.006472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:03:49.014182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bc382f58-aa73-4416-99be-7e3b13fbe98e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1682 microversion: 2.1 time: 0.176530 Aug 24 10:03:49.014741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1135/2248] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:48 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:50.035456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:50.036101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:50.043611 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:50.044237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:50.044796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:50.045596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:50.046075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:50.046593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:50.350643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:03:50.359056 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c895e0f1-064b-4f3e-9632-aca3d0b2564a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1682 microversion: 2.1 time: 0.327475 Aug 24 10:03:50.359573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1114/2249] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:50 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1682 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:51.242581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-db1f5435-e23d-4251-95a2-537e1bf7ec26 req-97b9b1ec-c208-4433-b50f-69f00b2a6aae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f835766-0103-492d-86a7-f3b9f896c37b", "name": "network-vif-deleted", "tag": "7955813c-a7c5-47c8-ba15-55938d56036d"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:03:51.252476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-db1f5435-e23d-4251-95a2-537e1bf7ec26 req-97b9b1ec-c208-4433-b50f-69f00b2a6aae service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:51.253070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-db1f5435-e23d-4251-95a2-537e1bf7ec26 req-97b9b1ec-c208-4433-b50f-69f00b2a6aae service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:51.253709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-db1f5435-e23d-4251-95a2-537e1bf7ec26 req-97b9b1ec-c208-4433-b50f-69f00b2a6aae service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:51.265987 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-db1f5435-e23d-4251-95a2-537e1bf7ec26 req-97b9b1ec-c208-4433-b50f-69f00b2a6aae service nova] Creating event network-vif-deleted:7955813c-a7c5-47c8-ba15-55938d56036d for instance 9f835766-0103-492d-86a7-f3b9f896c37b on hv-cinder-85032 Aug 24 10:03:51.272448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-db1f5435-e23d-4251-95a2-537e1bf7ec26 req-97b9b1ec-c208-4433-b50f-69f00b2a6aae service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.348747 Aug 24 10:03:51.273708 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1136/2250] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:51.383444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:51.385628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:51.394293 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:51.397345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:51.398599 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:51.401217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:51.401722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:51.402151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:51.437399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:51.437924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:51.438366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:51.438818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lazy-loading 'fault' on Instance uuid 9f835766-0103-492d-86a7-f3b9f896c37b {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:03:51.501407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:03:51.511615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0d8fa909-6b08-4ee7-8e8d-7709e578a55f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 200 len: 1330 microversion: 2.1 time: 0.133147 Aug 24 10:03:51.512549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1115/2251] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:51 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 1330 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:52.535183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:52.536476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:52.544565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:52.545248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:52.546268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:52.547225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:52.548156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:52.548659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:52.563747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b HTTP/1.1 Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:03:52.565768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:03:52.566967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '9f835766-0103-492d-86a7-f3b9f896c37b'} Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:03:52.568356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:03:52.569474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:03:52.570529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:03:52.570529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-32e05a89-1ceb-4db0-a8e3-b738db22c227 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 404 len: 111 microversion: 2.1 time: 0.037466 Aug 24 10:03:52.570529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1137/2252] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:52 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:03:52.576451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e84f2a4-9e86-47f2-8270-98de9083f90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '.version_select at 0x7fa912e47d30>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:52.657484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e84f2a4-9e86-47f2-8270-98de9083f90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-536183724" status: 202 len: 0 microversion: 2.1 time: 0.085065 Aug 24 10:03:52.659154 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1116/2253] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Aug 24 10:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-536183724 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:03:53.571609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f746e5b6-76bc-4e15-aa19-251b5505ca5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: .version_select at 0x7fa912e9a160>, body: {"keypair": {"name": "tempest-keypair-590057919", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEo/St6E+M2E6koaq+xI7M9HrSWCjkGDJPdVcTYD8Y5vePU7HfLE1JR3STQmcOSQwgwsTlSYN3zpjHyugbSl4QTDn+ZyTtTjI+3+H11IRMWvj/AdcZ5e172ULidFmAgdaw=="}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:03:53.589772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-f746e5b6-76bc-4e15-aa19-251b5505ca5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:03:53.596910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-f746e5b6-76bc-4e15-aa19-251b5505ca5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:03:53.709278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f746e5b6-76bc-4e15-aa19-251b5505ca5a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141792 Aug 24 10:03:53.709960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1138/2254] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 10:03:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:03:56.313689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1067365109", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2d78a8de-2c64-4044-abe6-4ba1346bd716"}], "security_groups": [{"name": "tempest-securitygroup--556979709"}], "key_name": "tempest-keypair-590057919", "user_data": "}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:03:56.424652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] validate_networks() for [('2d78a8de-2c64-4044-abe6-4ba1346bd716', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:03:57.113621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:03:57.114072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:03:57.114582 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:03:57.115022 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:03:57.115439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:03:57.124377 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:57.124864 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:57.125309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:57.126039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:57.126497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:57.126926 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:57.144032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:03:57.148008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Getting quotas for user def04335e57e48409a6943fa231d47c3 and project a99aef25597a4ab480625b53c48cfe80. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:03:57.159088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:03:57.161406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:03:57.391110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ff33cf38-3ee1-47c1-b60b-d49cfeb3a4b6 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.082377 Aug 24 10:03:57.392002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1117/2255] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 10:03:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1084 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:03:57.403625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eb3a3cde-80ea-4b9b-abe3-05887d53c95a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:57.404249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eb3a3cde-80ea-4b9b-abe3-05887d53c95a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:57.460809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eb3a3cde-80ea-4b9b-abe3-05887d53c95a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:03:57.467948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eb3a3cde-80ea-4b9b-abe3-05887d53c95a tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1241 microversion: 2.1 time: 0.069032 Aug 24 10:03:57.468887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1139/2256] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:57 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1241 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:58.493811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:58.495211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:58.504745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:58.505684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:58.506280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:58.506995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:58.507681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:58.508066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:58.588560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:03:58.604214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f807a61c-f38b-4383-a97a-aeb7c8bb3379 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1245 microversion: 2.1 time: 0.118864 Aug 24 10:03:58.615604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1118/2257] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:58 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1245 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:03:59.628210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:03:59.628818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:03:59.635314 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:59.635718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:59.636153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:59.636882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:03:59.637266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:03:59.637981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:03:59.721752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:03:59.733319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2fb7a5fb-5e41-421d-8284-36dc25c5ba49 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1293 microversion: 2.1 time: 0.109406 Aug 24 10:03:59.733904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1140/2258] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:03:59 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1293 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:00.754887 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:00.756246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:00.763208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:00.763999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:00.764515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:00.765296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:00.765839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:00.766338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:00.829418 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:00.839681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-843d7d3a-3668-4bec-b028-4cd63efbef39 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1293 microversion: 2.1 time: 0.088548 Aug 24 10:04:00.852800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1119/2259] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:00 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:01.860088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:01.861847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:01.868225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:01.868707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:01.869143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:01.869939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:01.870308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:01.870729 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:01.935950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:01.944924 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-656234d2-889c-4134-aa3c-3ec30a95119d tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1293 microversion: 2.1 time: 0.088552 Aug 24 10:04:01.947790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1141/2260] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:01 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1293 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:04:02.966761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:02.967456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:02.974165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:02.974763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:02.975492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:02.976900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:02.977534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:02.978219 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:03.054491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:03.068069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c53c6c22-e0ef-43a9-8ffb-10f840b4fbbb tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1293 microversion: 2.1 time: 0.100945 Aug 24 10:04:03.068069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1120/2261] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:02 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:04.085813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:04.086477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:04.092528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:04.093005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:04.093443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:04.094135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:04.094591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:04.095019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:04.161395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:04.168922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ccc46a65-9d37-48a4-b82b-ab8229b37535 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1293 microversion: 2.1 time: 0.087814 Aug 24 10:04:04.169475 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1142/2262] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:04 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1293 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:05.191298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:05.192499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:05.199263 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:05.199793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:05.200228 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:05.200941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:05.201425 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:05.201923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:05.415346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:05.423100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-67c46b94-9194-49f6-ae04-46dcd1e868fd tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.236925 Aug 24 10:04:05.423831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1121/2263] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:05 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:06.044330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-c3110ac4-1791-4708-9ba0-3873736e95cc req-27bc0145-e000-4ec0-bdbe-673f3ca83fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c103fb8-42a3-4127-9d90-5fef416a2f0e", "tag": "fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:04:06.060100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-c3110ac4-1791-4708-9ba0-3873736e95cc req-27bc0145-e000-4ec0-bdbe-673f3ca83fe2 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:06.060588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-c3110ac4-1791-4708-9ba0-3873736e95cc req-27bc0145-e000-4ec0-bdbe-673f3ca83fe2 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:06.063399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-c3110ac4-1791-4708-9ba0-3873736e95cc req-27bc0145-e000-4ec0-bdbe-673f3ca83fe2 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:06.081822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-c3110ac4-1791-4708-9ba0-3873736e95cc req-27bc0145-e000-4ec0-bdbe-673f3ca83fe2 service nova] Creating event network-changed:fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8 for instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e on hv-cinder-85032 Aug 24 10:04:06.087721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-c3110ac4-1791-4708-9ba0-3873736e95cc req-27bc0145-e000-4ec0-bdbe-673f3ca83fe2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046956 Aug 24 10:04:06.088574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1143/2264] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:04:06.444382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:06.444976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:06.451506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:06.452126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:06.452470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:06.453341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:06.453950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:06.454807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:06.828557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:06.837358 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bdec5a67-792d-460a-b2e7-c6303668447b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.396925 Aug 24 10:04:06.837928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1122/2265] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:06 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:07.856028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:07.860153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:07.860861 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:07.868408 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:07.869000 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:07.869502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:07.870289 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:07.871028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:07.871394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:08.037652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:08.045302 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4870b1e8-6da2-46f6-8443-e0c2bb55e483 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.190745 Aug 24 10:04:08.058795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1144/2266] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:07 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:09.065539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:09.066205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:09.068086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:09.068751 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=6 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:09.073930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:09.074448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:09.074872 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:09.082915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:09.083961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:09.084497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:09.220929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:09.229296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-71c9bd07-5c7d-423b-936f-0d54103ff1cf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.167610 Aug 24 10:04:09.229860 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1123/2267] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:09 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:10.249772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:10.250386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:10.256817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:10.257309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:10.257746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:10.258419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:10.258864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:10.259386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:10.412091 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:10.419506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ede1106c-2488-4e42-a328-fe395e524394 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.173496 Aug 24 10:04:10.420137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1145/2268] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:10 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:04:11.440959 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:11.441566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:11.449687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:11.450188 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:11.450655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:11.451550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:11.451823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:11.458207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:11.583808 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:11.591423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5f7812b3-4e70-4f23-9ffd-8e94c3189b45 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.154710 Aug 24 10:04:11.592012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1124/2269] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:11 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:12.611722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:12.612339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:12.618644 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:12.622090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:12.622090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:12.622090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:12.622090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:12.622514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:12.748334 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:12.755956 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7485b5f5-69cd-4432-b7d2-c493d7ad93b5 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.148053 Aug 24 10:04:12.756508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1146/2270] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:12 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:13.776097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:13.776733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:13.787495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:13.787495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:13.787495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:13.787495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:13.788317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:13.788317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:13.921645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:13.930449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2781112e-06b7-453f-a219-7f346f096f80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.158608 Aug 24 10:04:13.931013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1125/2271] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:13 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:14.951127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:14.951825 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:14.954085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:14.959898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:14.960385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:14.960824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:14.965697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:14.965697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:14.965697 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:14.966321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=78,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:15.101877 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:15.109553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d24385e6-fea5-4830-9069-c6b4322e8275 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.162206 Aug 24 10:04:15.110113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1147/2272] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:14 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:04:16.130207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:16.130915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:16.133266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:16.142414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:16.142414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:16.142414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:16.142414 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:16.142754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:16.142754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:16.144503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=89 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:16.271514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:16.279079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d1b9a7dc-9a13-4d60-8bc3-6953b66d10ef tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.152755 Aug 24 10:04:16.279650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1126/2273] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:16 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:04:17.299768 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:17.300543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:17.308386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:17.308858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:17.309301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:17.310013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:17.310500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:17.310930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:17.445927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:17.453951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bcc72dde-0dbf-46cb-8b6f-28a099fed968 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.158176 Aug 24 10:04:17.454040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1148/2274] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:17 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:18.478799 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:18.479439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:18.487412 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:18.487930 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:18.488382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:18.489069 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:18.489528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:18.490558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:18.625620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:18.633419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d57ac01e-05c6-4f2e-8ff8-febcc0ad9a80 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.158979 Aug 24 10:04:18.634252 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1127/2275] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:18 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:19.654961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:19.655569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:19.662469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:19.662985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:19.663416 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:19.664135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:19.664581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:19.670805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:19.795137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:19.802772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-99773930-04a5-4850-b053-7f2bf09160b3 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.151700 Aug 24 10:04:19.804041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1149/2276] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:19 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:20.822732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:20.826701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:20.830305 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:20.830787 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:20.831218 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:20.831966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:20.832420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:20.832849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:20.961120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:20.968726 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bdee2af1-0747-4015-a6f9-581e4c8052e2 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.149842 Aug 24 10:04:20.969289 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1128/2277] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:20 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:21.992232 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:21.993490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:22.000086 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:22.000572 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:22.001107 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:22.001803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:22.002566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:22.002991 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:22.140537 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:22.149831 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3e4e3cc6-f1e2-42d7-b064-558c2a2945a9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.161481 Aug 24 10:04:22.150665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1150/2278] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:21 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:23.171096 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:23.173573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:23.180819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:23.181291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:23.182072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:23.182852 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:23.183370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:23.183882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:23.225518 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-5e082b55-8f8f-44d2-b3a8-9790770f7360 req-adb0cf4b-15e5-404e-a153-c81c5332cb03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c103fb8-42a3-4127-9d90-5fef416a2f0e", "name": "network-vif-plugged", "status": "completed", "tag": "fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:04:23.238540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5e082b55-8f8f-44d2-b3a8-9790770f7360 req-adb0cf4b-15e5-404e-a153-c81c5332cb03 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:23.239034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5e082b55-8f8f-44d2-b3a8-9790770f7360 req-adb0cf4b-15e5-404e-a153-c81c5332cb03 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:23.239896 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-5e082b55-8f8f-44d2-b3a8-9790770f7360 req-adb0cf4b-15e5-404e-a153-c81c5332cb03 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:23.253147 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-5e082b55-8f8f-44d2-b3a8-9790770f7360 req-adb0cf4b-15e5-404e-a153-c81c5332cb03 service nova] Creating event network-vif-plugged:fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8 for instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e on hv-cinder-85032 Aug 24 10:04:23.259125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-5e082b55-8f8f-44d2-b3a8-9790770f7360 req-adb0cf4b-15e5-404e-a153-c81c5332cb03 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197248 Aug 24 10:04:23.260512 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1129/2279] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:04:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:04:23.332396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:23.340829 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-70c6c31a-065c-416b-889f-8f370ec259bc tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.174295 Aug 24 10:04:23.341343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1151/2280] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:23 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:24.363283 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:24.364052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:24.371202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:24.371715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:24.372153 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:24.372976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:24.373405 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:24.373831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:24.507985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:24.517987 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d19bde4d-ad0a-4ca2-95af-a75c5196d593 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.159043 Aug 24 10:04:24.518557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1130/2281] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:24 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:25.540933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:25.541629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:25.548564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:25.550320 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:25.550929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:25.551909 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:25.552889 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:25.553319 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:25.696132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:25.704802 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7cd232f2-adff-488a-8bd2-41703fd6fe84 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.168476 Aug 24 10:04:25.705807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1152/2282] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:25 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:26.731312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:26.732644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:26.739036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:26.739524 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:26.740565 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:26.741264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:26.741791 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:26.742302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:26.890833 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:26.906033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d607410c-5da9-438b-af63-f31ae5dc1269 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1366 microversion: 2.1 time: 0.180040 Aug 24 10:04:26.906964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1131/2283] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:26 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:04:27.928454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:27.929121 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:27.935487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:27.936001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:27.936436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:27.937111 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:27.937587 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:27.938008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:28.073658 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:28.082001 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e217657e-44d1-4571-8c44-3dc3d13b70aa tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1556 microversion: 2.1 time: 0.157880 Aug 24 10:04:28.082501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1153/2284] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:27 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1556 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:28.105807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:28.106390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:28.112515 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:28.112991 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:28.113424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:28.114116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:28.114573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:28.115042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:28.194095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-13409881-17e9-4686-bb2e-952fb2d45a58 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092035 Aug 24 10:04:28.194680 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1132/2285] 10.222.0.16 () {58 vars in 1275 bytes} [Wed Aug 24 10:04:28 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:04:29.263217 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-fbace16f-f4ba-4f18-be43-49d7f2ce8152 req-677f93bc-9b72-4635-af0c-ddff17256f34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c103fb8-42a3-4127-9d90-5fef416a2f0e", "tag": "fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:04:29.273545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-fbace16f-f4ba-4f18-be43-49d7f2ce8152 req-677f93bc-9b72-4635-af0c-ddff17256f34 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:29.274298 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-fbace16f-f4ba-4f18-be43-49d7f2ce8152 req-677f93bc-9b72-4635-af0c-ddff17256f34 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:29.274900 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-fbace16f-f4ba-4f18-be43-49d7f2ce8152 req-677f93bc-9b72-4635-af0c-ddff17256f34 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:29.286092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-fbace16f-f4ba-4f18-be43-49d7f2ce8152 req-677f93bc-9b72-4635-af0c-ddff17256f34 service nova] Creating event network-changed:fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8 for instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e on hv-cinder-85032 Aug 24 10:04:29.292324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-fbace16f-f4ba-4f18-be43-49d7f2ce8152 req-677f93bc-9b72-4635-af0c-ddff17256f34 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032987 Aug 24 10:04:29.292946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1154/2286] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:04:50.995914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:04:50.996659 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:04:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:04:56.172530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=13 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:56.173342 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=35 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:56.177255 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a84ce641-fa7b-4c47-b2bd-2203ce9e6ccf tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Action: 'create', calling method: .version_select at 0x7fa91b69d040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1538005051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0LRll0g4IdgN1O+eJ9lLWCNXllW+beKrwthxsnrhOrrtwqkhgH5NEM5cIM/wnvCg6K0lDwFlcnB4HDJjqjzZkGnQWJMTr+SfeTFwNA/rOqt1xLJXsQOw07d1LSD3ceBA=="}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:04:56.192640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-a84ce641-fa7b-4c47-b2bd-2203ce9e6ccf tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Getting quotas for project 428f4e988b10492c87dddc5a0c4f34fb. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:04:56.197847 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-a84ce641-fa7b-4c47-b2bd-2203ce9e6ccf tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Getting quotas for user ea68de414dcd4ff79bfd0a1305c58f63 and project 428f4e988b10492c87dddc5a0c4f34fb. Resources: {'key_pairs'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:04:56.384921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a84ce641-fa7b-4c47-b2bd-2203ce9e6ccf tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.213835 Aug 24 10:04:56.385511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1133/2287] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 10:04:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:04:56.482788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=15 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:56.483569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=43 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:04:56.487749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1146510645", "imageRef": "884399f8-877e-43ed-a00c-448ac9fe5c79", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1538005051", "networks": [{"uuid": "c912f228-1e03-49ca-9a68-cf29e398d863"}]}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:04:56.520499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-111632206", "imageRef": "33a799a8-ddd6-41b0-9b87-be7ca4a02989", "flavorRef": "452"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:04:56.701092 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] validate_networks() for [('c912f228-1e03-49ca-9a68-cf29e398d863', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:04:56.736096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] validate_networks() for None {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:04:57.008259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:04:57.008690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:04:57.009167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:04:57.009577 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:04:57.009990 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:04:57.018730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:57.019217 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:57.019681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:57.020419 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:57.020877 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:57.021800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:57.039549 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Getting quotas for project 3d902f7914f649e0b534a24e469e09c4. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:04:57.043848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Getting quotas for user 00cea9a8c4924fc18bb0e94d2adbb92b and project 3d902f7914f649e0b534a24e469e09c4. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:04:57.054874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:04:57.057242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='33a799a8-ddd6-41b0-9b87-be7ca4a02989',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:04:57.174034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:04:57.174482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:04:57.174961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:04:57.175373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:04:57.175834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:04:57.184627 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:57.185113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:57.185554 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:57.186442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:57.186899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:57.187329 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:57.203803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Getting quotas for project 428f4e988b10492c87dddc5a0c4f34fb. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:04:57.208231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Getting quotas for user ea68de414dcd4ff79bfd0a1305c58f63 and project 428f4e988b10492c87dddc5a0c4f34fb. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:04:57.220407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:04:57.222735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='884399f8-877e-43ed-a00c-448ac9fe5c79',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:04:57.224928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d6e0b216-eb97-47a1-b64c-1042e695eeb1 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708238 Aug 24 10:04:57.226046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1134/2288] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 10:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 24 10:04:57.237547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b5b92004-73f2-46cb-b354-82fe01dcea98 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:57.238490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b5b92004-73f2-46cb-b354-82fe01dcea98 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:57.291849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b5b92004-73f2-46cb-b354-82fe01dcea98 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:57.300287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b5b92004-73f2-46cb-b354-82fe01dcea98 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1214 microversion: 2.1 time: 0.067287 Aug 24 10:04:57.300891 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1135/2289] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:57 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:04:57.398477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-28fecfcb-68fb-40af-a6c4-918a3ce8a794 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917229 Aug 24 10:04:57.399120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1155/2290] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 10:04:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:04:57.409732 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-064ca2fd-61af-45f7-9b29-3cbc395293b4 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:57.410642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-064ca2fd-61af-45f7-9b29-3cbc395293b4 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:57.721838 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-064ca2fd-61af-45f7-9b29-3cbc395293b4 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:57.728767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-064ca2fd-61af-45f7-9b29-3cbc395293b4 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1259 microversion: 2.1 time: 0.322938 Aug 24 10:04:57.729326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1136/2291] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:57 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1259 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:58.321344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bad84129-9ad0-4ac1-b6fe-ae7939179884 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:58.321952 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bad84129-9ad0-4ac1-b6fe-ae7939179884 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:58.376395 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bad84129-9ad0-4ac1-b6fe-ae7939179884 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:58.384010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bad84129-9ad0-4ac1-b6fe-ae7939179884 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1214 microversion: 2.1 time: 0.067477 Aug 24 10:04:58.384570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1156/2292] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:58 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:58.750932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:58.750932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:58.757711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:58.758201 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:58.758638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:58.759338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:58.759831 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:58.760259 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:58.823943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:58.831514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4c2cfc4e-bda9-440d-8df0-63325b6879ec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1263 microversion: 2.1 time: 0.085811 Aug 24 10:04:58.832366 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1137/2293] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:58 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1263 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:59.404510 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:59.405151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:59.411820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:59.412303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:59.412741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:59.413425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:59.413879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:59.414304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:59.477221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:59.485029 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-34ece01f-e5a5-4659-a5b0-15862abccf86 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1266 microversion: 2.1 time: 0.084500 Aug 24 10:04:59.485582 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1157/2294] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:59 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:04:59.853058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:04:59.853697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:04:59.860243 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:59.860725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:59.861158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:59.861850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:04:59.862302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:04:59.862724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:04:59.934276 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:04:59.942823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8c2f77cb-e718-4646-8852-ca679d8763af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1311 microversion: 2.1 time: 0.094850 Aug 24 10:04:59.944097 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1138/2295] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:04:59 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:00.505722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:00.506957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:00.513453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:00.513841 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:00.514590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:00.515296 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:00.515792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:00.516224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:00.582767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:00.591064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0715796a-f7fa-4f36-9cd0-2268408d0cee tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1272 microversion: 2.1 time: 0.089464 Aug 24 10:05:00.591864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1158/2296] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:00 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:00.964586 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:00.965211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:00.971575 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:00.972093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:00.972535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:00.973231 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:00.973685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:00.974112 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:01.330493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:01.348756 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d4dba027-f375-4a16-9c05-0ee63a490f12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.387091 Aug 24 10:05:01.351287 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1139/2297] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:00 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:01.631386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:01.632080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:01.651470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:01.652027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:01.652434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:01.653139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:01.653591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:01.654013 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:01.898306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:01.918602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e1e7ada9-8e69-41d9-ba01-57d550394f0d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.307571 Aug 24 10:05:01.918602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1159/2298] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:01 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:02.288196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-ca7ba15c-ec3c-4dc5-a054-bd8f6b1603e2 req-47657b2c-1127-46c1-b5e1-99e1660188f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dec17ad-c8bf-452c-8515-92b4460f467f", "tag": "a509bcf1-742c-42e3-bc1c-3fc8ad8d4349"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:02.309303 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-ca7ba15c-ec3c-4dc5-a054-bd8f6b1603e2 req-47657b2c-1127-46c1-b5e1-99e1660188f4 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:02.310072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-ca7ba15c-ec3c-4dc5-a054-bd8f6b1603e2 req-47657b2c-1127-46c1-b5e1-99e1660188f4 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:02.310538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-ca7ba15c-ec3c-4dc5-a054-bd8f6b1603e2 req-47657b2c-1127-46c1-b5e1-99e1660188f4 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:02.323178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-ca7ba15c-ec3c-4dc5-a054-bd8f6b1603e2 req-47657b2c-1127-46c1-b5e1-99e1660188f4 service nova] Creating event network-changed:a509bcf1-742c-42e3-bc1c-3fc8ad8d4349 for instance 4dec17ad-c8bf-452c-8515-92b4460f467f on hv-cinder-85032 Aug 24 10:05:02.335455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-ca7ba15c-ec3c-4dc5-a054-bd8f6b1603e2 req-47657b2c-1127-46c1-b5e1-99e1660188f4 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050893 Aug 24 10:05:02.336100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1140/2299] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:05:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:02.373238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:02.376418 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:02.379990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:02.380997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:02.381501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:02.382188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:02.382670 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:02.383088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:02.525928 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:02.533633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-955effe6-8cee-4ab3-a63d-ef7dabf8b983 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.165977 Aug 24 10:05:02.534200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1160/2300] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:02 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:02.937629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:02.938330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:02.945364 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:02.945778 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:02.946195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:02.946901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:02.947361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:02.947834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:03.096542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:03.106165 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c39cd3b7-6a4c-40e2-b795-f99061476c6e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.172718 Aug 24 10:05:03.107660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1141/2301] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:02 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:03.555560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:03.556568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:03.562948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:03.563706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:03.564300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:03.565401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:03.565859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:03.566323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:03.716868 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:03.726373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-be3cbb14-26cb-4c8d-8228-346d84df71b7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.174709 Aug 24 10:05:03.726950 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1161/2302] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:03 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:04.126901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:04.127539 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:04.134123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:04.134601 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:04.135051 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:04.135785 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:04.136232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:04.136658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:04.270372 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:04.278668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-820d0797-3074-40bd-95b8-a2e69565b4fa tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.156219 Aug 24 10:05:04.279227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1142/2303] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:04 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:04.746293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:04.747660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:04.754545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:04.755034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:04.756016 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:04.756728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:04.757182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:04.757616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:04.896551 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:04.908112 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e8c12af5-44f7-49a5-af4c-3055ed132f41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.165573 Aug 24 10:05:04.908687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1162/2304] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:04 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:05.300720 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:05.302129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:05.309882 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:05.310365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:05.310832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:05.311557 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:05.312175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:05.312866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:05.458326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:05.466805 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f45893a8-d3e8-4d20-b28c-2c08d850366e tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.170069 Aug 24 10:05:05.474915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1143/2305] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:05 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:05.928971 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:05.929569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:05.936054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:05.936533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:05.936968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:05.937688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:05.938139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:05.938591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:06.079252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:06.088540 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-687f4807-6c95-470b-97e6-29b7cb89f891 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.163424 Aug 24 10:05:06.089113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1163/2306] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:05 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:06.487627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:06.488261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:06.501057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:06.501567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:06.502010 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:06.502715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:06.503173 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:06.503650 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:06.659221 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:06.667928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-042ef74e-3f20-4112-b18d-1923b4a09cfc tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.184218 Aug 24 10:05:06.669869 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1144/2307] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:06 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:07.109253 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:07.109881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:07.117003 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:07.117485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:07.117917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:07.118603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:07.119308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:07.119955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:07.194550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:07.272067 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:07.279529 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eb26fcd6-6cd7-41c8-b5cd-0bcf1416aa80 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.174236 Aug 24 10:05:07.280165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1164/2308] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:07 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:07.689890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:07.690528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:07.692493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:07.698073 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:07.698561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:07.698995 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:07.699781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:07.700235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:07.700658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:07.725555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=14 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:07.860639 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:07.868538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7480805d-3617-4799-8f50-5822892cc190 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.182479 Aug 24 10:05:07.869106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1145/2309] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:07 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:08.301953 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:08.304333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:08.319466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:08.319466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:08.319466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:08.319466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:08.319823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:08.319823 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:08.383736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=8 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:08.456231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:08.465920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-69309046-7e2a-4f08-9866-b7f72e6d77e7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.169305 Aug 24 10:05:08.466501 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1165/2310] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:08 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:08.888336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:08.888955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:08.895260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:08.895772 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:08.896235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:08.897015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:08.897470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:08.897888 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:09.042213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:09.042213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6091217e-8368-41c7-a7db-af1aa3b23485 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.157137 Aug 24 10:05:09.042597 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1146/2311] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:08 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:09.486851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:09.487574 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:09.494059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:09.494545 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:09.494981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:09.495869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:09.496330 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:09.496759 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:09.629547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:09.637643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a087e8d9-8e7d-441e-8f43-524e42dcaf12 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.155143 Aug 24 10:05:09.647767 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1166/2312] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:09 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:10.062559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:10.063340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:10.070749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:10.071244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:10.072050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:10.072846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:10.073098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:10.073554 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:10.208519 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:10.214389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f41a57c7-db61-414c-9cb3-5834eb9a1d26 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.155691 Aug 24 10:05:10.214964 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1147/2313] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:10 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:10.658646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:10.659260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:10.666570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:10.667059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:10.667480 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:10.668182 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:10.668633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:10.669056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:10.795494 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:10.803824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b8e455cc-51b1-4a7b-b006-1c62bdcc23b6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.148909 Aug 24 10:05:10.804386 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1167/2314] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:10 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:11.234199 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:11.234749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:11.241106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:11.241587 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:11.242025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:11.242710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:11.243162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:11.243610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:11.374909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:11.383268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-982f0fde-5bc3-4ae7-bc41-0ff98ca8e166 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.152957 Aug 24 10:05:11.383867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1148/2315] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:11 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:11.824894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:11.825507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:11.831899 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:11.832643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:11.833069 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:11.833794 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:11.834242 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:11.834662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:11.964077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:11.971663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0a462b0a-879b-47c4-964e-6affa31172a8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.150558 Aug 24 10:05:11.972231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1168/2316] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:11 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:12.403682 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:12.404296 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:12.410394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:12.410874 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:12.411312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:12.412025 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:12.412486 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:12.412919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:12.540207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:12.547715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-84680454-55e0-45ac-b320-ed0a09580d68 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.147891 Aug 24 10:05:12.548279 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1149/2317] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:12 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:12.993914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:12.994447 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:13.001204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:13.001691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:13.002165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:13.002858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:13.003312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:13.003834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:13.130694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:13.138740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-00de2c5d-aae1-4514-8e48-25596d99ad9f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.149163 Aug 24 10:05:13.139311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1169/2318] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:12 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:13.568890 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:13.569449 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:13.575762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:13.578150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:13.578150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:13.578150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:13.578150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:13.578511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:13.707876 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:13.716542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f53ee567-286e-4b5b-94b5-f21d3e3d347b tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.152036 Aug 24 10:05:13.717105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1150/2319] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:13 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:14.159601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:14.160168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:14.166520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:14.167010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:14.167444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:14.168159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:14.168613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:14.169039 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:14.298455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:14.307056 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6db895a8-5c98-4c6e-89e6-44f04674bc8c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.151398 Aug 24 10:05:14.307649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1170/2320] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:14 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:14.736666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:14.737291 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:14.743370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:14.743881 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:14.744544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:14.745251 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:14.745701 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:14.746348 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:14.949205 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:14.957516 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-af48caac-e13b-46f9-a4c9-d0b870ba41ea tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.224342 Aug 24 10:05:14.958239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1151/2321] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:14 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:15.183118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-dddea79a-5eec-46db-87ab-0db37c0d162f req-40507294-b7eb-4a1e-9489-fd9ae60e8208 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22341a9e-59da-4b18-bb68-4db62c549ad7", "tag": "30684267-95ed-4870-a614-1bf9f0bc9efc"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:15.192676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-dddea79a-5eec-46db-87ab-0db37c0d162f req-40507294-b7eb-4a1e-9489-fd9ae60e8208 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:15.193707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-dddea79a-5eec-46db-87ab-0db37c0d162f req-40507294-b7eb-4a1e-9489-fd9ae60e8208 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:15.194142 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-dddea79a-5eec-46db-87ab-0db37c0d162f req-40507294-b7eb-4a1e-9489-fd9ae60e8208 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:15.205046 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-dddea79a-5eec-46db-87ab-0db37c0d162f req-40507294-b7eb-4a1e-9489-fd9ae60e8208 service nova] Creating event network-changed:30684267-95ed-4870-a614-1bf9f0bc9efc for instance 22341a9e-59da-4b18-bb68-4db62c549ad7 on hv-cinder-85032 Aug 24 10:05:15.210581 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-dddea79a-5eec-46db-87ab-0db37c0d162f req-40507294-b7eb-4a1e-9489-fd9ae60e8208 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099539 Aug 24 10:05:15.211156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1171/2322] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:15.326914 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:15.327789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:15.334873 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:15.335367 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:15.335846 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:15.336541 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:15.342394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:15.342394 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:15.463523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:15.471158 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f74eb802-a1e1-44a2-8bbb-5494d3f575bb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.148188 Aug 24 10:05:15.471978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1152/2323] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:15 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:15.979779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:15.980469 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:15.986531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:15.987006 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:15.987437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:15.988151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:15.988599 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:15.989018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:16.115097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:16.122652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3e9b2aaa-19c9-4aee-9de0-bacc98bb9a06 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.147087 Aug 24 10:05:16.123204 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1172/2324] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:15 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:16.491455 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:16.492108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:16.498559 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:16.499046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:16.499482 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:16.500196 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:16.500651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:16.501076 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:16.624893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:16.628336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=100 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:16.632735 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cca3b42f-0417-4437-b4e7-feb841e011b1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.145770 Aug 24 10:05:16.641207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1153/2325] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:16 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:17.143108 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:17.143676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:17.150518 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:17.150997 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:17.151434 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:17.152149 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:17.152603 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:17.153031 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:17.283748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:17.287354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=100 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:17.291765 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-87187d2c-d926-479a-b176-2b2ce1006bad tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.152549 Aug 24 10:05:17.292318 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1173/2326] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:17 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:17.652880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:17.653492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:17.659875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:17.660355 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:17.660789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:17.661476 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:17.661931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:17.662361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:17.789038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:17.796606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8200fa3f-cdd3-4223-a8dd-b8bc041a002b tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.147878 Aug 24 10:05:17.797202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1154/2327] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:17 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:05:18.312147 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:18.313090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:18.320004 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:18.320478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:18.320904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:18.321579 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:18.322025 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:18.322444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:18.450960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:18.459492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e5310f19-22c5-4385-9ffb-5b752262b801 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.150535 Aug 24 10:05:18.459982 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1174/2328] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:18 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:18.817192 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:18.817803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:18.824654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:18.825264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:18.825699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:18.826383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:18.826832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:18.827253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:18.955024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:18.962967 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-73a979a5-e0b3-4f06-8c64-ac15d12feb42 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.149657 Aug 24 10:05:18.963538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1155/2329] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:18 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:19.480115 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:19.480614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:19.486630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:19.487126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:19.487562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:19.488295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:19.488749 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:19.489179 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:19.616070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:19.623515 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-723d7aba-9e43-4243-8d55-e1a4e43fd8b0 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.147360 Aug 24 10:05:19.624105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1175/2330] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:19 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:19.983481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:19.984204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:19.991100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:19.991600 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:19.992072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:19.992761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:19.993216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:19.993645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:20.124052 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:20.132299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8c6cf250-c26e-460c-937f-39b6dabfacd7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.152589 Aug 24 10:05:20.132858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1156/2331] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:19 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:20.644166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:20.644781 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:20.651573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:20.652075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:20.652575 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:20.653258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:20.653709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:20.654135 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:20.781620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:20.789151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e214ac91-b636-4f62-8929-6e9de3482bf5 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.148800 Aug 24 10:05:20.789707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1176/2332] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:20 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:21.152651 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:21.153271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:21.159681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:21.160164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:21.160605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:21.161298 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:21.162241 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:21.162681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:21.290006 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:21.297746 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a1e47f52-7074-4f2a-8721-90a67e1e9ebb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.148892 Aug 24 10:05:21.298311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1157/2333] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:21 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:21.419033 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-d16c929b-6a06-47b5-adad-c540553eac03 req-d04edb4f-30df-4c42-bf37-fb95bbaf661b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dec17ad-c8bf-452c-8515-92b4460f467f", "name": "network-vif-plugged", "status": "completed", "tag": "a509bcf1-742c-42e3-bc1c-3fc8ad8d4349"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:21.428640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d16c929b-6a06-47b5-adad-c540553eac03 req-d04edb4f-30df-4c42-bf37-fb95bbaf661b service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:21.429140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d16c929b-6a06-47b5-adad-c540553eac03 req-d04edb4f-30df-4c42-bf37-fb95bbaf661b service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:21.429567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d16c929b-6a06-47b5-adad-c540553eac03 req-d04edb4f-30df-4c42-bf37-fb95bbaf661b service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:21.440892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-d16c929b-6a06-47b5-adad-c540553eac03 req-d04edb4f-30df-4c42-bf37-fb95bbaf661b service nova] Creating event network-vif-plugged:a509bcf1-742c-42e3-bc1c-3fc8ad8d4349 for instance 4dec17ad-c8bf-452c-8515-92b4460f467f on hv-cinder-85032 Aug 24 10:05:21.445966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-d16c929b-6a06-47b5-adad-c540553eac03 req-d04edb4f-30df-4c42-bf37-fb95bbaf661b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030656 Aug 24 10:05:21.446723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1177/2334] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:21.810049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:21.810670 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:21.817042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:21.817528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:21.818028 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:21.818866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:21.819325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:21.819782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:22.026707 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:22.034602 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5a19f1c6-76d4-42be-bb29-44a5d3c251a7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.228833 Aug 24 10:05:22.035167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1158/2335] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:21 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:22.320809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:22.321534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:22.327673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:22.328155 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:22.328591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:22.329283 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:22.329733 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:22.330152 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:22.462994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:22.470796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-1e56d052-049d-4987-8126-4b2e00fea656 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.155431 Aug 24 10:05:22.471360 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1178/2336] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:22 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:23.055502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:23.056260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:23.062629 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:23.063115 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:23.063555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:23.064278 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:23.064737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:23.065166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:23.192356 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:23.200044 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-68392486-4a33-418a-b892-dfb2b3558be2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.148438 Aug 24 10:05:23.200616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1159/2337] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:23 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:23.491054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:23.491848 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:23.498194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:23.501202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:23.501202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:23.501202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:23.501202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:23.501522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:23.629804 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:23.638101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cd89dd77-15a0-4a40-b78a-01cb76a66757 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.150925 Aug 24 10:05:23.640190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1179/2338] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:23 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:24.221399 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:24.222042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:24.229502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:24.230120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:24.230758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:24.231492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:24.231973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:24.232403 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:24.364641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:24.372313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9dd973fd-83a3-4009-a508-eba0d1e7b4b2 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1314 microversion: 2.1 time: 0.154940 Aug 24 10:05:24.372862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1160/2339] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:24 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:24.658243 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:24.658855 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:24.665750 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:24.666230 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:24.666874 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:24.667420 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:24.667905 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:24.668328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:24.797429 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:24.805094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-999f66f1-b0c3-4db7-ab32-32fd98847f2f tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.150652 Aug 24 10:05:24.805649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1180/2340] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:24 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:25.393363 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:25.393973 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:25.400343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:25.400818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:25.401265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:25.401932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:25.402513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:25.402942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:25.541032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:25.553668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8d6969d6-7759-4d2b-b6fd-6bf47a7438b7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1463 microversion: 2.1 time: 0.163599 Aug 24 10:05:25.554248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1161/2341] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:25 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1463 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:25.573507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-d78d5824-dfac-4c70-b859-8100476d18e1 req-4056953b-b297-486f-b0ae-99b7afabdac7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22341a9e-59da-4b18-bb68-4db62c549ad7", "name": "network-vif-plugged", "status": "completed", "tag": "30684267-95ed-4870-a614-1bf9f0bc9efc"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:25.588207 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d78d5824-dfac-4c70-b859-8100476d18e1 req-4056953b-b297-486f-b0ae-99b7afabdac7 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:25.588688 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d78d5824-dfac-4c70-b859-8100476d18e1 req-4056953b-b297-486f-b0ae-99b7afabdac7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:25.589119 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-d78d5824-dfac-4c70-b859-8100476d18e1 req-4056953b-b297-486f-b0ae-99b7afabdac7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:25.600726 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-d78d5824-dfac-4c70-b859-8100476d18e1 req-4056953b-b297-486f-b0ae-99b7afabdac7 service nova] Creating event network-vif-plugged:30684267-95ed-4870-a614-1bf9f0bc9efc for instance 22341a9e-59da-4b18-bb68-4db62c549ad7 on hv-cinder-85032 Aug 24 10:05:25.607539 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-d78d5824-dfac-4c70-b859-8100476d18e1 req-4056953b-b297-486f-b0ae-99b7afabdac7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036418 Aug 24 10:05:25.607687 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:25.607800 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1181/2342] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:25.607899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:25.612932 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:25.613420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:25.613983 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:25.614679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:25.615779 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:25.616214 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:25.641329 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:05:25.826385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:25.827073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:25.833559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:25.839292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:25.839292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:25.839292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:25.839292 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:25.839713 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:25.983728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:25.991481 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e882fdd2-2ff1-42f3-b0aa-6d3bd6d82c41 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.169813 Aug 24 10:05:25.992082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1182/2343] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:25 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:05:26.016900 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-dfbe2469-1cab-4322-a9ec-ad9915ed517d tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "DELETE /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 204 len: 0 microversion: 2.1 time: 0.414573 Aug 24 10:05:26.020331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1162/2344] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:05:25 2022] DELETE /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:05:26.027564 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:26.028208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:26.034185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:26.034667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:26.035101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:26.035819 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:26.036268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:26.036694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:26.178752 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:26.186492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2e7570be-bd4d-4f1d-87ae-5233e5d4b8af tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1469 microversion: 2.1 time: 0.162709 Aug 24 10:05:26.187062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1183/2345] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:26 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:27.012408 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:27.013026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:27.015437 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:27.020063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:27.020538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:27.020965 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:27.021641 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:27.022089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:27.022505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:27.150643 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:27.158226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e03dc45c-2c85-4e03-b411-6a2988e417d3 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.150153 Aug 24 10:05:27.158792 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1163/2346] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:27 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:27.206959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:27.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:27.210223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:27.214936 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:27.215457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:27.215957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:27.222423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:27.222423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:27.222423 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:27.351508 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:27.359097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c28f26f7-5c22-4e8e-a414-781331fce564 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1469 microversion: 2.1 time: 0.155909 Aug 24 10:05:27.359682 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1184/2347] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:27 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:28.179066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:28.179700 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:28.186105 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:28.186576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:28.187003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:28.187712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:28.188334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:28.189481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:28.316692 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:28.324198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8f1c8a10-ee58-4fc7-921d-59e7b55315b8 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.149162 Aug 24 10:05:28.324770 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1164/2348] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:28 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:28.380287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:28.381017 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:28.387615 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:28.388118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:28.388535 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:28.389209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:28.389655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:28.390073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:28.515441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:28.523592 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ff81ac82-d1d0-479b-b506-3f154bf51c9a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1469 microversion: 2.1 time: 0.147111 Aug 24 10:05:28.524161 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1185/2349] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:28 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1469 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:29.345715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:29.346334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:29.352893 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:29.353382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:29.353821 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:29.354505 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:29.354961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:29.355388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:29.517473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:29.525941 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7085e4fc-9091-49da-879f-21fbeafdd924 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1359 microversion: 2.1 time: 0.184111 Aug 24 10:05:29.526497 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1165/2350] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:29 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:29.544414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:29.545148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:29.551818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:29.552308 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:29.553165 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:29.553506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:29.554041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:29.554385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:29.695443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:29.703193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-68437da7-8e7d-454a-a77a-d8e8210145d7 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1469 microversion: 2.1 time: 0.162895 Aug 24 10:05:29.704101 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1186/2351] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:29 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:30.038382 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-6709c5b7-175d-475b-9a43-626fee09251c req-624e898f-7627-4eb1-97a0-ffba257336f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dec17ad-c8bf-452c-8515-92b4460f467f", "name": "network-vif-deleted", "tag": "a509bcf1-742c-42e3-bc1c-3fc8ad8d4349"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:30.048183 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6709c5b7-175d-475b-9a43-626fee09251c req-624e898f-7627-4eb1-97a0-ffba257336f9 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.048761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6709c5b7-175d-475b-9a43-626fee09251c req-624e898f-7627-4eb1-97a0-ffba257336f9 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.049193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6709c5b7-175d-475b-9a43-626fee09251c req-624e898f-7627-4eb1-97a0-ffba257336f9 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.062026 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-6709c5b7-175d-475b-9a43-626fee09251c req-624e898f-7627-4eb1-97a0-ffba257336f9 service nova] Creating event network-vif-deleted:a509bcf1-742c-42e3-bc1c-3fc8ad8d4349 for instance 4dec17ad-c8bf-452c-8515-92b4460f467f on hv-cinder-85032 Aug 24 10:05:30.067207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-6709c5b7-175d-475b-9a43-626fee09251c req-624e898f-7627-4eb1-97a0-ffba257336f9 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033026 Aug 24 10:05:30.067832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1166/2352] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:30.546917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:30.547536 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:30.554005 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.554426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.554859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.555541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.556015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.556437 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.685453 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:30.693168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4daac711-8509-4374-9e55-86957a9c254a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1550 microversion: 2.1 time: 0.150113 Aug 24 10:05:30.702268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1187/2353] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:30 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1550 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:30.714318 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:30.715012 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:30.722059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.722541 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.722976 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.723690 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.724105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:30.724224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.725116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.725277 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:30.731385 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.736754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.736754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.736754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.736754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.737098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.764673 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.765157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.765601 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.766047 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lazy-loading 'fault' on Instance uuid 4dec17ad-c8bf-452c-8515-92b4460f467f {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:05:30.807166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00cea9a8c4924fc18bb0e94d2adbb92b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d902f7914f649e0b534a24e469e09c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:30.815380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-13b6d278-0c32-47d4-9e0d-86eb73fafd11 tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 200 len: 1304 microversion: 2.1 time: 0.095185 Aug 24 10:05:30.815980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1188/2354] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:30 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:05:30.861417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:30.869057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-723fe208-919e-4fae-aa06-044ee84ea7e9 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1550 microversion: 2.1 time: 0.159116 Aug 24 10:05:30.869610 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1167/2355] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:30 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1550 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:30.888570 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:30.893424 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:30.894187 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Searching by: {'deleted': False, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb'} {{(pid=121141) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 24 10:05:30.901393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.901878 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.902316 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:30.903042 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:30.903498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:30.903955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:31.011740 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.multi_cell_list [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121141) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 24 10:05:31.110325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-90fa3e86-c486-40e2-88c5-be680d156bdc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.225366 Aug 24 10:05:31.110832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1189/2356] 10.222.0.16 () {58 vars in 1125 bytes} [Wed Aug 24 10:05:30 2022] GET /compute/v2.1/servers => generated 343 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:05:31.121798 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:31.122467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:31.130829 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:31.131468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:31.131963 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:31.132790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:31.133087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:31.133702 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:31.263373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:31.270994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-00398eff-f497-4ae2-938f-187dc912de2c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1550 microversion: 2.1 time: 0.152996 Aug 24 10:05:31.272119 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1168/2357] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:31 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1550 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:31.837227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:31.837837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] [instance: 4dec17ad-c8bf-452c-8515-92b4460f467f] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:31.844369 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:31.844806 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:31.845235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:31.845922 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:31.846370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:31.853402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:31.860496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] HTTP exception thrown: Instance 4dec17ad-c8bf-452c-8515-92b4460f467f could not be found. Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Request method failure captured: Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f HTTP/1.1 Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBffFYPgVPRCZehRwK4XMZVmMI-zjC-i-KttLTcfp61JH5SYxZk7p0AVZVh53Xmlpumb9nh1KbzKYk72kyZZ_eEP_8WdGq-MFkmJ0Rsuc64TfHiK0o9cQaua9SRWyV2XKgP4rSeb4njlmU6rAvTX7GHB12vScgb6pDWY-4JvuHPAX3rM Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 3d902f7914f649e0b534a24e469e09c4 Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-VolumesNegativeTest-1162607870 Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:05:31.862200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/3d902f7914f649e0b534a24e469e09c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d902f7914f649e0b534a24e469e09c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/3d902f7914f649e0b534a24e469e09c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_3d902f7914f649e0b534a24e469e09c4", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-VolumesNegativeTest-1162607870 Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 3d902f7914f649e0b534a24e469e09c4 Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-VolumesNegativeTest-1162607870 Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-VolumesNegativeTest-1162607870-project Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 00cea9a8c4924fc18bb0e94d2adbb92b Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-VolumesNegativeTest-1162607870-project Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 4dec17ad-c8bf-452c-8515-92b4460f467f could not be found. Aug 24 10:05:31.863756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '4dec17ad-c8bf-452c-8515-92b4460f467f'} Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dec17ad-c8bf-452c-8515-92b4460f467f could not be found. Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:05:31.864668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dec17ad-c8bf-452c-8515-92b4460f467f could not be found. Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dec17ad-c8bf-452c-8515-92b4460f467f could not be found. Aug 24 10:05:31.866123 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:05:31.867407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] Returning 404 to user: Instance 4dec17ad-c8bf-452c-8515-92b4460f467f could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:05:31.867407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b1efd0ee-091f-458c-bdd4-5a78c8f3902a tempest-VolumesNegativeTest-1162607870 tempest-VolumesNegativeTest-1162607870-project] 10.222.0.16 "GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f" status: 404 len: 111 microversion: 2.1 time: 0.031038 Aug 24 10:05:31.867407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1190/2358] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:31 2022] GET /compute/v2.1/servers/4dec17ad-c8bf-452c-8515-92b4460f467f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:05:34.344383 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9996a05f-cabc-4247-90cd-a045c8963854"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:34.350264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:34.354478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:34.354606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:34.355761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:34.357088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:34.357556 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:34.357986 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:34.376937 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:35.354878 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-eb6dd3e8-f0fa-4169-890b-6c779c9b8007 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.014180 Aug 24 10:05:35.355479 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1169/2359] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 10:05:34 2022] POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments => generated 194 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:43.981966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:43.982571 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:43.984960 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:43.990562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=15 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:43.990562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=94 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:43.991707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:43.992376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:43.992809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:43.993497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:43.993947 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:43.994370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:44.124869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:44.133268 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-103a80c6-8c9f-433c-9a67-1b96932639d2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1596 microversion: 2.1 time: 0.155179 Aug 24 10:05:44.133816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1191/2360] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:43 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1596 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:05:46.550654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-3efa9b77-4fc6-470b-aed4-937e2849b0ee req-69516ac9-3844-4974-829e-52cf9ecf34b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22341a9e-59da-4b18-bb68-4db62c549ad7", "tag": "30684267-95ed-4870-a614-1bf9f0bc9efc"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:46.556427 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=13 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:46.557325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=7,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:05:46.563312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efa9b77-4fc6-470b-aed4-937e2849b0ee req-69516ac9-3844-4974-829e-52cf9ecf34b2 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:46.564674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efa9b77-4fc6-470b-aed4-937e2849b0ee req-69516ac9-3844-4974-829e-52cf9ecf34b2 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:46.564674 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-3efa9b77-4fc6-470b-aed4-937e2849b0ee req-69516ac9-3844-4974-829e-52cf9ecf34b2 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:46.576493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-3efa9b77-4fc6-470b-aed4-937e2849b0ee req-69516ac9-3844-4974-829e-52cf9ecf34b2 service nova] Creating event network-changed:30684267-95ed-4870-a614-1bf9f0bc9efc for instance 22341a9e-59da-4b18-bb68-4db62c549ad7 on hv-cinder-85032 Aug 24 10:05:46.582490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-3efa9b77-4fc6-470b-aed4-937e2849b0ee req-69516ac9-3844-4974-829e-52cf9ecf34b2 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035535 Aug 24 10:05:46.583075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1170/2361] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:05:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:49.457505 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-707494708"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:49.457968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:49.466651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:49.467127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:49.467563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:49.468254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:49.468698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:49.469120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:49.593931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.network.security_group_api [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Adding security group 16822d1e-a7a1-477d-aa24-c0d5a10315f8 to port 30684267-95ed-4870-a614-1bf9f0bc9efc Aug 24 10:05:49.962970 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-484dc65c-87a1-4fca-aafd-00deee8c17f1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.509447 Aug 24 10:05:49.963569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1192/2362] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Aug 24 10:05:49 2022] POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:05:49.972317 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:05:49.973169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-71613bca-ca6e-49e2-8af8-7df821442dd2 req-0d5331cc-9570-425a-9033-fda276852284 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22341a9e-59da-4b18-bb68-4db62c549ad7", "tag": "30684267-95ed-4870-a614-1bf9f0bc9efc"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:05:49.973797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:05:49.981982 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:49.982469 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:49.982624 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-71613bca-ca6e-49e2-8af8-7df821442dd2 req-0d5331cc-9570-425a-9033-fda276852284 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:49.982907 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:49.983022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-71613bca-ca6e-49e2-8af8-7df821442dd2 req-0d5331cc-9570-425a-9033-fda276852284 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:49.983435 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-71613bca-ca6e-49e2-8af8-7df821442dd2 req-0d5331cc-9570-425a-9033-fda276852284 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:49.983850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:05:49.984304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:05:49.984728 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:05:49.996625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-71613bca-ca6e-49e2-8af8-7df821442dd2 req-0d5331cc-9570-425a-9033-fda276852284 service nova] Creating event network-changed:30684267-95ed-4870-a614-1bf9f0bc9efc for instance 22341a9e-59da-4b18-bb68-4db62c549ad7 on hv-cinder-85032 Aug 24 10:05:50.002095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-71613bca-ca6e-49e2-8af8-7df821442dd2 req-0d5331cc-9570-425a-9033-fda276852284 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032394 Aug 24 10:05:50.003504 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1193/2363] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:05:50.194741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:05:50.212265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b17fabe0-d90c-4a8e-9959-d3d7551a7569 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1760 microversion: 2.1 time: 0.243633 Aug 24 10:05:50.213568 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1171/2364] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:05:49 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1760 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:06:14.576771 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:14.577476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=12 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:14.581555 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:14.582168 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:14.588849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:14.589326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:14.589764 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:14.590451 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:14.590902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:14.591326 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:14.615961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d76d4150-e4f0-449f-901e-3cccdcd27001 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/ips" status: 200 len: 150 microversion: 2.1 time: 0.038812 Aug 24 10:06:14.615961 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1194/2365] 10.222.0.16 () {58 vars in 1248 bytes} [Wed Aug 24 10:06:14 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:06:17.305789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23544ded-b46c-4e54-a05e-ced0c8d59209"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:06:17.308098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:17.310273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:17.310921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=8 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:17.315640 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:17.324163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:17.324163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:17.324163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:17.324163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:17.324533 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:18.045535 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-26983faf-9cf1-4333-bf55-491c9382a90e tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "POST /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.743491 Aug 24 10:06:18.046236 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1172/2366] 10.222.0.16 () {60 vars in 1323 bytes} [Wed Aug 24 10:06:17 2022] POST /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments => generated 194 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:06:21.498116 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:06:21.498633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:06:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:06:26.733274 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:26.733895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:26.736505 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:06:26.741639 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:26.742122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:26.742616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:26.743249 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:26.743728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:26.750026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:26.825492 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lazy-loading 'services' on Instance uuid 5c103fb8-42a3-4127-9d90-5fef416a2f0e {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:06:27.079977 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d7144a4e-d4a7-4a4c-a901-7e53093116bf tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments/23544ded-b46c-4e54-a05e-ced0c8d59209" status: 202 len: 0 microversion: 2.1 time: 0.350602 Aug 24 10:06:27.080578 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1195/2367] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Aug 24 10:06:26 2022] DELETE /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments/23544ded-b46c-4e54-a05e-ced0c8d59209 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:06:27.090712 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:27.093088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:27.099903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:27.100444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:27.100919 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:27.101609 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:27.102068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:27.102493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:27.132413 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0d125926-c788-452b-9627-26b988a85255 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046548 Aug 24 10:06:27.132969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1173/2368] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:06:27 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:06:28.145527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:28.148527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:28.154683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:28.155167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:28.155626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:28.156328 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:28.156783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:28.157214 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:28.187083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-997ce4f1-964b-4677-8211-285ca506d890 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046283 Aug 24 10:06:28.187672 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1196/2369] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:06:28 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:06:29.200138 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:29.202340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:29.208858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:29.209339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:29.209777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:29.210724 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:29.211179 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:29.211624 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:29.240451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-86604cdf-498e-43b7-813f-022962af5b83 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043859 Aug 24 10:06:29.240999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1174/2370] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:06:29 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:06:29.299676 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:29.300194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:29.307015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:29.307497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:29.307975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:29.308666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:29.309117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:29.309546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:29.334209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:06:29.658790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-184d5e02-fde9-45e0-a0a6-825c930b5356 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 204 len: 0 microversion: 2.1 time: 0.362711 Aug 24 10:06:29.659396 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1197/2371] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:06:29 2022] DELETE /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:06:29.667928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:29.668545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:29.674615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:29.675114 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:29.675534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:29.676242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:29.676697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:29.677125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:29.811125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:06:29.818819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-45c1ba02-72ef-4ca3-9dae-9b3a3e57e1ee tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1681 microversion: 2.1 time: 0.154692 Aug 24 10:06:29.819379 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1175/2372] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:29 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:06:30.841062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:30.841797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:30.848167 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:30.848662 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:30.849100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:30.849789 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:30.850244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:30.850669 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:30.979476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:06:30.987198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-92d8934c-d4fb-48e4-abee-49085883c51c tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1681 microversion: 2.1 time: 0.150969 Aug 24 10:06:30.988009 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1198/2373] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:30 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:06:32.009673 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:32.010072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:32.016237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:32.016750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:32.017193 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:32.017880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:32.018337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:32.018761 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:32.255818 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:06:32.263897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bc2615d3-e224-420f-b797-4cc888a23234 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1681 microversion: 2.1 time: 0.258641 Aug 24 10:06:32.264460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1176/2374] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:32 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:06:32.921008 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-a03f8f07-8ac4-42d8-a3b1-1959c7a58f78 req-750979b1-6fa3-430f-a34d-9508fc5de186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c103fb8-42a3-4127-9d90-5fef416a2f0e", "name": "network-vif-deleted", "tag": "fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:06:32.933263 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a03f8f07-8ac4-42d8-a3b1-1959c7a58f78 req-750979b1-6fa3-430f-a34d-9508fc5de186 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:32.933779 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a03f8f07-8ac4-42d8-a3b1-1959c7a58f78 req-750979b1-6fa3-430f-a34d-9508fc5de186 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:32.934212 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-a03f8f07-8ac4-42d8-a3b1-1959c7a58f78 req-750979b1-6fa3-430f-a34d-9508fc5de186 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:32.947324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-a03f8f07-8ac4-42d8-a3b1-1959c7a58f78 req-750979b1-6fa3-430f-a34d-9508fc5de186 service nova] Creating event network-vif-deleted:fbb1f2d9-1ca9-4656-873d-5e1bcc7ffdc8 for instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e on hv-cinder-85032 Aug 24 10:06:32.952426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-a03f8f07-8ac4-42d8-a3b1-1959c7a58f78 req-750979b1-6fa3-430f-a34d-9508fc5de186 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036419 Aug 24 10:06:32.953040 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1199/2375] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:06:33.285168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:33.285999 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:33.292096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:33.301186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:33.301186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:33.301186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:33.301186 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:33.301671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:33.359123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'def04335e57e48409a6943fa231d47c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a99aef25597a4ab480625b53c48cfe80', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:06:33.367181 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-5e5c20e0-9e45-4112-b315-a2ada1f38e8b tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 200 len: 1326 microversion: 2.1 time: 0.085830 Aug 24 10:06:33.367823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1177/2376] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:33 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 1326 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:06:34.389495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:34.390196 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:34.396199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:34.396671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:34.397185 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:34.398059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:34.398538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:34.398975 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:34.412223 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e HTTP/1.1 Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:06:34.413796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:34.415288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '5c103fb8-42a3-4127-9d90-5fef416a2f0e'} Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:06:34.416216 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:34.418010 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:34.419332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:06:34.419332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4fb5da34-fcee-4a6b-9fa7-706371fde30f tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 404 len: 111 microversion: 2.1 time: 0.030562 Aug 24 10:06:34.419332 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1200/2377] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:34 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:06:34.426063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-fb363c4d-26fe-419c-8815-5d8c085f88d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '.version_select at 0x7fa91b69da60>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:34.529208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-fb363c4d-26fe-419c-8815-5d8c085f88d7 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-590057919" status: 202 len: 0 microversion: 2.1 time: 0.106865 Aug 24 10:06:34.529786 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1178/2378] 10.222.0.16 () {58 vars in 1218 bytes} [Wed Aug 24 10:06:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-590057919 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:06:36.791363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:36.791939 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:36.798209 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:36.798691 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:36.799126 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:36.799838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:36.800290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:36.800712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:36.814258 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: DELETE /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e HTTP/1.1 Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:06:36.815832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.817290 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '5c103fb8-42a3-4127-9d90-5fef416a2f0e'} Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:06:36.818225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.819667 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.821502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:06:36.821502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-faca55f3-e984-414f-89b4-011634d2eae8 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 404 len: 111 microversion: 2.1 time: 0.030165 Aug 24 10:06:36.821502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1201/2379] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:06:36 2022] DELETE /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:06:36.826087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:36.826706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 5c103fb8-42a3-4127-9d90-5fef416a2f0e] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:36.833238 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:36.833725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:36.834162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:36.834849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:36.835570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:36.836058 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:36.848875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e HTTP/1.1 Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:06:36.850507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.852463 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '5c103fb8-42a3-4127-9d90-5fef416a2f0e'} Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:06:36.853357 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. Aug 24 10:06:36.854782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:36.856109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 5c103fb8-42a3-4127-9d90-5fef416a2f0e could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:06:36.856109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2d3838c4-1395-4a14-b674-6d0bf1005887 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e" status: 404 len: 111 microversion: 2.1 time: 0.030088 Aug 24 10:06:36.856109 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1179/2380] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:36 2022] GET /compute/v2.1/servers/5c103fb8-42a3-4127-9d90-5fef416a2f0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 24 10:06:38.206063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:38.206528 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:38.213054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.213526 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.213957 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.214633 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.215080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.215495 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.228293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: DELETE /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b HTTP/1.1 Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:06:38.229805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.231321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '9f835766-0103-492d-86a7-f3b9f896c37b'} Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:06:38.232120 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.233457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.234851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:06:38.234851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f6c97050-ed5b-464d-9708-1abfab9c3f06 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 404 len: 111 microversion: 2.1 time: 0.028976 Aug 24 10:06:38.234851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1202/2381] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:06:38 2022] DELETE /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:06:38.251369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:38.252034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 9f835766-0103-492d-86a7-f3b9f896c37b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:38.258401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.259452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.259923 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.260595 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.261072 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.261490 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.274266 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b HTTP/1.1 Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:06:38.275807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.277330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '9f835766-0103-492d-86a7-f3b9f896c37b'} Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:06:38.278167 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. Aug 24 10:06:38.279561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.280816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 9f835766-0103-492d-86a7-f3b9f896c37b could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:06:38.280816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-2962ddb8-1062-484d-aa8d-b86d843fa588 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b" status: 404 len: 111 microversion: 2.1 time: 0.029632 Aug 24 10:06:38.280816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1180/2382] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:38 2022] GET /compute/v2.1/servers/9f835766-0103-492d-86a7-f3b9f896c37b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:06:38.285364 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:38.285861 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:38.292191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.292668 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.293100 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.293776 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.294226 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.294645 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.308344 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: DELETE /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 HTTP/1.1 Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:06:38.309870 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.311325 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '8e2c3983-8b10-4ca8-b317-368b1ebeffb5'} Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:06:38.312190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.313530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.315024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:06:38.315024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-e7300813-cb02-447c-84bb-2a55e70c7fc4 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 404 len: 111 microversion: 2.1 time: 0.029661 Aug 24 10:06:38.315024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1203/2383] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:06:38 2022] DELETE /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:06:38.319468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:06:38.320130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: 8e2c3983-8b10-4ca8-b317-368b1ebeffb5] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:06:38.326024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.326495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.326927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.327628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:06:38.328079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:06:38.328502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:06:38.341765 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 HTTP/1.1 Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:06:38.343261 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.344763 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': '8e2c3983-8b10-4ca8-b317-368b1ebeffb5'} Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:06:38.345606 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. Aug 24 10:06:38.346947 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:06:38.348151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance 8e2c3983-8b10-4ca8-b317-368b1ebeffb5 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:06:38.348151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-623707dd-4563-4e57-a3f9-f4bcd7dd1225 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5" status: 404 len: 111 microversion: 2.1 time: 0.028961 Aug 24 10:06:38.348151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1181/2384] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:06:38 2022] GET /compute/v2.1/servers/8e2c3983-8b10-4ca8-b317-368b1ebeffb5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:07:13.154932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:07:13.157129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:13.159393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:13.160080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:13.164707 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:13.165194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:13.165634 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:13.166321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:13.166772 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:13.167194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:13.382474 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d0e0638a-23be-4da3-b3e1-f37031b33bb1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.231271 Aug 24 10:07:13.383208 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1204/2385] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Aug 24 10:07:13 2022] POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:07:13.391316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:13.392407 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:13.394122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=21,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:13.394797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=47,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:07:13.399434 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:13.399953 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:13.400389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:13.401079 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:13.401531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:13.401957 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:13.542567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:13.551299 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-70ce796a-52aa-47d5-8b7e-7e259b46dabc tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1752 microversion: 2.1 time: 0.163999 Aug 24 10:07:13.551960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1182/2386] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:13 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:14.573473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:14.574087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:14.581562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:14.582041 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:14.582470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:14.583157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:14.583629 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:14.584059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:14.726163 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:14.734194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5be006c9-c4be-4a9a-84e4-233b5dd4862e tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.165665 Aug 24 10:07:14.734746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1205/2387] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:14 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:15.755739 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:15.756268 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:15.763832 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:15.764312 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:15.764750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:15.765437 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:15.765889 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:15.766311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:15.904376 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:15.912593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a0b7dd19-48a3-40fc-8892-0003544d54f5 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.161397 Aug 24 10:07:15.913150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1183/2388] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:15 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:16.933106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:16.935193 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:16.940599 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:16.941072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:16.941497 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:16.942170 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:16.942621 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:16.943034 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:17.084701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:17.093133 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c97a8baf-5508-42f6-938c-4037c0b384a1 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.163889 Aug 24 10:07:17.093720 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1206/2389] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:16 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:18.113848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:18.114491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:18.121164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:18.121642 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:18.122078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:18.122758 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:18.123213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:18.123668 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:18.265093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:18.273855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0feb573d-3962-4f45-96ee-6d2b98c09252 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.163976 Aug 24 10:07:18.274424 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1184/2390] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:18 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:19.294792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:19.295393 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:19.302898 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:19.303383 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:19.303847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:19.304543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:19.305002 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:19.305425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:19.463151 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:19.471879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7215662b-f264-4743-8f63-e61c97ae618d tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.180743 Aug 24 10:07:19.472443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1207/2391] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:19 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:20.492591 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:20.493239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:20.499915 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:20.500400 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:20.500841 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:20.501529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:20.501985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:20.502921 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:20.643710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:20.651824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7f9b0ddf-cb85-43d6-a9c8-29d6042569fb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.163074 Aug 24 10:07:20.652590 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1185/2392] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:20 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:21.671777 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:21.672310 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:21.678468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:21.678938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:21.679373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:21.680077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:21.680606 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:21.681028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:21.819735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:21.827929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bd7bdb97-5077-4665-954d-b8e8d07c67be tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.160097 Aug 24 10:07:21.828487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1208/2393] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:21 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:22.850159 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:22.850777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:22.857135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:22.857616 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:22.858054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:22.858743 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:22.859202 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:22.859655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:23.003212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:23.011353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-4290d8d4-66cd-4e19-b422-e526d23af000 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.165566 Aug 24 10:07:23.011948 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1186/2394] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:22 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:24.031696 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:24.032309 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:24.038760 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:24.039235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:24.039703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:24.040373 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:24.040817 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:24.041238 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:24.183630 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:24.192333 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-48f6b8d8-4593-4727-924a-1fa41899041c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.164543 Aug 24 10:07:24.192885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1209/2395] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:24 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:25.213333 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:25.213934 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:25.220353 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:25.220834 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:25.221264 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:25.221944 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:25.222395 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:25.222820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:25.366100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:25.375898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c02790cf-b71a-493f-a965-51991f5c1083 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1757 microversion: 2.1 time: 0.166619 Aug 24 10:07:25.376473 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1187/2396] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:25 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:07:26.401206 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:07:26.401826 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:07:26.408281 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:26.408818 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:26.409260 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:26.410525 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:07:26.410981 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:07:26.411409 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:07:26.549538 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:07:26.558358 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7e0941e3-7875-4a17-a4c4-a5e762ee7b06 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1760 microversion: 2.1 time: 0.160975 Aug 24 10:07:26.558862 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1210/2397] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:07:26 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1760 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:08:08.535088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:08:08.535698 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:08:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:08:11.007908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:08:11.008460 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:08:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:08:33.695015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=12 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:33.695804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=36 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:33.699745 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-707494708"}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:08:33.700307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:33.706068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:33.706544 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:33.706997 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:33.707693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:33.708146 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:33.708567 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:33.839898 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.network.security_group_api [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Removing security group 16822d1e-a7a1-477d-aa24-c0d5a10315f8 from port 30684267-95ed-4870-a614-1bf9f0bc9efc Aug 24 10:08:34.195972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-14987023-b18b-4412-b4b9-253e01232b81 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/action" status: 202 len: 0 microversion: 2.1 time: 0.502459 Aug 24 10:08:34.196931 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1188/2398] 10.222.0.16 () {60 vars in 1278 bytes} [Wed Aug 24 10:08:33 2022] POST /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/action => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:08:34.205921 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 10:08:34.210030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=14 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:34.210030 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:08:34.212295 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-57a96e30-874d-4e27-ae9b-4e2b83ce9905 req-16ad878f-f5f7-4af5-aee7-cd74b0136edc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22341a9e-59da-4b18-bb68-4db62c549ad7", "tag": "30684267-95ed-4870-a614-1bf9f0bc9efc"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:08:34.222254 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-57a96e30-874d-4e27-ae9b-4e2b83ce9905 req-16ad878f-f5f7-4af5-aee7-cd74b0136edc service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:34.222951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-57a96e30-874d-4e27-ae9b-4e2b83ce9905 req-16ad878f-f5f7-4af5-aee7-cd74b0136edc service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:34.224134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-57a96e30-874d-4e27-ae9b-4e2b83ce9905 req-16ad878f-f5f7-4af5-aee7-cd74b0136edc service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:34.236306 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-57a96e30-874d-4e27-ae9b-4e2b83ce9905 req-16ad878f-f5f7-4af5-aee7-cd74b0136edc service nova] Creating event network-changed:30684267-95ed-4870-a614-1bf9f0bc9efc for instance 22341a9e-59da-4b18-bb68-4db62c549ad7 on hv-cinder-85032 Aug 24 10:08:34.242048 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-57a96e30-874d-4e27-ae9b-4e2b83ce9905 req-16ad878f-f5f7-4af5-aee7-cd74b0136edc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037937 Aug 24 10:08:34.244597 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1211/2399] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:08:35.387338 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:35.388423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:35.390652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-30070e51-e08a-40b8-af76-318a145f4724 req-3c6439b7-ba57-4295-8fe3-49844ee48dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22341a9e-59da-4b18-bb68-4db62c549ad7", "tag": "30684267-95ed-4870-a614-1bf9f0bc9efc"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:08:35.394540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:35.395035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:35.396007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:35.396837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:35.397528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:35.398024 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:35.401969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-30070e51-e08a-40b8-af76-318a145f4724 req-3c6439b7-ba57-4295-8fe3-49844ee48dfc service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:35.402440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-30070e51-e08a-40b8-af76-318a145f4724 req-3c6439b7-ba57-4295-8fe3-49844ee48dfc service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:35.402865 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-30070e51-e08a-40b8-af76-318a145f4724 req-3c6439b7-ba57-4295-8fe3-49844ee48dfc service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:35.414117 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 42488. Aug 24 10:08:35.416718 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-30070e51-e08a-40b8-af76-318a145f4724 req-3c6439b7-ba57-4295-8fe3-49844ee48dfc service nova] Creating event network-changed:30684267-95ed-4870-a614-1bf9f0bc9efc for instance 22341a9e-59da-4b18-bb68-4db62c549ad7 on hv-cinder-85032 Aug 24 10:08:35.421530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-30070e51-e08a-40b8-af76-318a145f4724 req-3c6439b7-ba57-4295-8fe3-49844ee48dfc service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036579 Aug 24 10:08:35.422626 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1212/2400] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:08:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:08:35.482665 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lazy-loading 'services' on Instance uuid 22341a9e-59da-4b18-bb68-4db62c549ad7 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:08:35.729691 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-32203906-a894-4109-89b4-441896a879d7 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments/9996a05f-cabc-4247-90cd-a045c8963854" status: 202 len: 0 microversion: 2.1 time: 0.347142 Aug 24 10:08:35.730555 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1189/2401] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Aug 24 10:08:35 2022] DELETE /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments/9996a05f-cabc-4247-90cd-a045c8963854 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:08:35.749623 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:35.752304 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:35.760498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:35.760996 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:35.761440 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:35.762156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:35.762891 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:35.763706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:35.803746 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-290c8f7f-6c30-47d1-a53f-b24f63d39eec tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060595 Aug 24 10:08:35.808683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1213/2402] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:08:35 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:08:36.820208 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:36.822340 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:36.829637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:36.830130 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:36.830572 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:36.831270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:36.831753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:36.832180 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:36.862388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-00faec94-be9f-49a9-bf37-6faa6f9bf84c tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049508 Aug 24 10:08:36.862950 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1190/2403] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:08:36 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:08:37.875476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:37.877628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:37.884938 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:37.885428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:37.885914 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:37.886616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:37.887078 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:37.887509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:37.915315 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-36fa6029-2994-40dc-80bf-36bda971ebde tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044100 Aug 24 10:08:37.915946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1214/2404] 10.222.0.16 () {58 vars in 1302 bytes} [Wed Aug 24 10:08:37 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 24 10:08:37.926211 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:37.929666 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:37.933753 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:37.934227 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:37.934659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:37.935341 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:37.935822 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:37.936242 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:38.009855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] HTTP exception thrown: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 is not attached to volume 9996a05f-cabc-4247-90cd-a045c8963854 Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Request method failure captured: Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments/9996a05f-cabc-4247-90cd-a045c8963854 HTTP/1.1 Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfe0J8sjFLw-TejbXD8jpVuPFMP-pUkuB9G6N8ZGDElNLZugzzjBLipERHcfdGke67ftJzyHX0Lb47RCPmsteVLF4F8OJOldZYM9gup9jbNEX4jHEtwJ_TKGi_v9ZfBwvQjMv4jbXCMBVhEltJ-H60pqBNWucA7dGpovCo0GnwXDxQs Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: 428f4e988b10492c87dddc5a0c4f34fb Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-TestMinimumBasicScenario-875421831 Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:08:38.012235 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/428f4e988b10492c87dddc5a0c4f34fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/428f4e988b10492c87dddc5a0c4f34fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/428f4e988b10492c87dddc5a0c4f34fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_428f4e988b10492c87dddc5a0c4f34fb", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-TestMinimumBasicScenario-875421831 Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: 428f4e988b10492c87dddc5a0c4f34fb Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875421831 Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-TestMinimumBasicScenario-875421831-project Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: ea68de414dcd4ff79bfd0a1305c58f63 Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-TestMinimumBasicScenario-875421831-project Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:08:38.013862 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 is not attached to volume 9996a05f-cabc-4247-90cd-a045c8963854 Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'server_id': '22341a9e-59da-4b18-bb68-4db62c549ad7', 'id': '9996a05f-cabc-4247-90cd-a045c8963854'} Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 9996a05f-cabc-4247-90cd-a045c8963854. Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:08:38.014817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 is not attached to volume 9996a05f-cabc-4247-90cd-a045c8963854 Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 is not attached to volume 9996a05f-cabc-4247-90cd-a045c8963854 Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:08:38.016232 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Returning 404 to user: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 is not attached to volume 9996a05f-cabc-4247-90cd-a045c8963854 {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:08:38.017747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f24cde50-ab28-4a4e-9fe9-27920937059a tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments/9996a05f-cabc-4247-90cd-a045c8963854" status: 404 len: 154 microversion: 2.1 time: 0.091243 Aug 24 10:08:38.017747 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1191/2405] 10.222.0.16 () {58 vars in 1416 bytes} [Wed Aug 24 10:08:37 2022] DELETE /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7/os-volume_attachments/9996a05f-cabc-4247-90cd-a045c8963854 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:08:39.304042 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:39.304466 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:39.310727 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:39.311205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:39.311664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:39.312349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:39.312796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:39.313220 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:39.337837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:08:39.609190 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-8dfc3313-e4c1-4b1c-9cb6-0672bc69dedb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "DELETE /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 204 len: 0 microversion: 2.1 time: 0.309177 Aug 24 10:08:39.609698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1215/2406] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:08:39 2022] DELETE /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:08:39.618564 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:39.619169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:39.625275 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:39.625748 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:39.626178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:39.626854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:39.627301 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:39.627902 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:39.756742 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:08:39.764551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-14277cc9-d957-4524-807a-ca94b616a3af tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1556 microversion: 2.1 time: 0.150476 Aug 24 10:08:39.765118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1192/2407] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:08:39 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:08:40.786070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:40.786793 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:40.793224 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:40.793704 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:40.794139 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:40.794824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:40.795278 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:40.795735 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:40.922205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:08:40.930412 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-18f04995-ef71-4fe5-989d-b235429045ee tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1556 microversion: 2.1 time: 0.148570 Aug 24 10:08:40.930985 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1216/2408] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:08:40 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1556 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:08:41.951850 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:41.952468 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:41.959110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:41.959615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:41.960054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:41.960740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:41.961195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:41.961621 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:42.189733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:08:42.197507 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-017a86f1-4b8b-4039-b7d1-b483cb3694c2 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1556 microversion: 2.1 time: 0.249540 Aug 24 10:08:42.198082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1193/2409] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:08:41 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1556 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:08:42.627917 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-b292a08a-b750-4fbc-aa75-f43591bf4962 req-8e48731d-2391-474e-95b8-52baf7017ca0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22341a9e-59da-4b18-bb68-4db62c549ad7", "name": "network-vif-deleted", "tag": "30684267-95ed-4870-a614-1bf9f0bc9efc"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:08:42.637966 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b292a08a-b750-4fbc-aa75-f43591bf4962 req-8e48731d-2391-474e-95b8-52baf7017ca0 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:42.639797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b292a08a-b750-4fbc-aa75-f43591bf4962 req-8e48731d-2391-474e-95b8-52baf7017ca0 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:42.639797 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-b292a08a-b750-4fbc-aa75-f43591bf4962 req-8e48731d-2391-474e-95b8-52baf7017ca0 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:42.650065 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-b292a08a-b750-4fbc-aa75-f43591bf4962 req-8e48731d-2391-474e-95b8-52baf7017ca0 service nova] Creating event network-vif-deleted:30684267-95ed-4870-a614-1bf9f0bc9efc for instance 22341a9e-59da-4b18-bb68-4db62c549ad7 on hv-cinder-85032 Aug 24 10:08:42.655146 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-b292a08a-b750-4fbc-aa75-f43591bf4962 req-8e48731d-2391-474e-95b8-52baf7017ca0 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030824 Aug 24 10:08:42.655728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1217/2410] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:08:43.218491 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:43.219111 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:43.225444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:43.225924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:43.226362 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:43.227068 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:43.227509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:43.227962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:43.257793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:43.258265 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:43.258699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:43.259143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lazy-loading 'fault' on Instance uuid 22341a9e-59da-4b18-bb68-4db62c549ad7 {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:08:43.299807 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68de414dcd4ff79bfd0a1305c58f63', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '428f4e988b10492c87dddc5a0c4f34fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:08:43.308370 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-224fdee8-46ee-4989-94b6-c570882284cb tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 200 len: 1349 microversion: 2.1 time: 0.094057 Aug 24 10:08:43.309039 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1194/2411] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:08:43 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 1349 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:08:44.330933 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:44.331660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] [instance: 22341a9e-59da-4b18-bb68-4db62c549ad7] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:08:44.337712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:44.338183 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:44.338613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:44.339546 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:08:44.340018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:08:44.340441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:08:44.353588 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] HTTP exception thrown: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 could not be found. Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Request method failure captured: Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 HTTP/1.1 Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBfe0J8sjFLw-TejbXD8jpVuPFMP-pUkuB9G6N8ZGDElNLZugzzjBLipERHcfdGke67ftJzyHX0Lb47RCPmsteVLF4F8OJOldZYM9gup9jbNEX4jHEtwJ_TKGi_v9ZfBwvQjMv4jbXCMBVhEltJ-H60pqBNWucA7dGpovCo0GnwXDxQs Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: 428f4e988b10492c87dddc5a0c4f34fb Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-TestMinimumBasicScenario-875421831 Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:08:44.355169 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/428f4e988b10492c87dddc5a0c4f34fb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/428f4e988b10492c87dddc5a0c4f34fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/428f4e988b10492c87dddc5a0c4f34fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_428f4e988b10492c87dddc5a0c4f34fb", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-TestMinimumBasicScenario-875421831 Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: 428f4e988b10492c87dddc5a0c4f34fb Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-TestMinimumBasicScenario-875421831 Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-TestMinimumBasicScenario-875421831-project Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: ea68de414dcd4ff79bfd0a1305c58f63 Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-TestMinimumBasicScenario-875421831-project Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 could not be found. Aug 24 10:08:44.356737 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': '22341a9e-59da-4b18-bb68-4db62c549ad7'} Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 could not be found. Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:08:44.357625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 could not be found. Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 could not be found. Aug 24 10:08:44.359129 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:08:44.360694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Returning 404 to user: Instance 22341a9e-59da-4b18-bb68-4db62c549ad7 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:08:44.360694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a403cd84-f044-42fa-b503-3bd8a44f04ba tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7" status: 404 len: 111 microversion: 2.1 time: 0.030476 Aug 24 10:08:44.360694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1218/2412] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:08:44 2022] GET /compute/v2.1/servers/22341a9e-59da-4b18-bb68-4db62c549ad7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:08:44.365619 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3e4011f8-66ca-49f6-9b02-3fbccdd24eb6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] Calling method '.version_select at 0x7fa91b69d040>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:08:44.430942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3e4011f8-66ca-49f6-9b02-3fbccdd24eb6 tempest-TestMinimumBasicScenario-875421831 tempest-TestMinimumBasicScenario-875421831-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1538005051" status: 202 len: 0 microversion: 2.1 time: 0.069597 Aug 24 10:08:44.431511 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1195/2413] 10.222.0.16 () {58 vars in 1272 bytes} [Wed Aug 24 10:08:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1538005051 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 24 10:09:41.506550 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:09:41.507027 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:09:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:11:28.543453 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:11:28.544038 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:11:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:11:30.123448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:11:30.124083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:11:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:11:31.016072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:11:31.016660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:11:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:11:43.068123 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:11:43.068653 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:11:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:12:00.928271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:12:00.928803 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:12:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:12:38.660783 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] AMQP server on 10.222.0.16:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 24 10:12:38.661391 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:38.662028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:38.665799 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:38.666287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:38.672701 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.673178 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.678134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.678134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.678134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.678134 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.688287 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: DELETE /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d HTTP/1.1 Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:12:38.689837 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.691394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'eb650451-50be-4714-b442-2a6cbcf96d6d'} Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:38.692270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.694883 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.696357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:38.696357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-eeac3170-c088-4b86-a63f-e4906716d788 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "DELETE /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 404 len: 111 microversion: 2.1 time: 0.032631 Aug 24 10:12:38.696357 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1219/2414] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:12:38 2022] DELETE /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:12:38.700676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:12:38.701868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:38.702775 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:12:38.707008 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:12:38.708273 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] [instance: eb650451-50be-4714-b442-2a6cbcf96d6d] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:12:38.713448 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.713929 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.714361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.715042 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:12:38.715500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:12:38.715952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:12:38.729311 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] HTTP exception thrown: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Request method failure captured: Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d HTTP/1.1 Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBe8gES4kykUYGIzn-dyrCbYmbfQfuypSUxYQZGTSalk7dDMphPSi9Ax504CcBVRiFxcojUdQ2kQ0sdRQ1CcYbzBJ0hXt_zNdJBvvDw_FTHn2gbvgmiwMFaFU3bgoe4TUcl-R8h89l4RSf-bAoHDOx6moSD5DpBGovW351w73Y3ovRlw Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:12:38.730809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/a99aef25597a4ab480625b53c48cfe80"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_a99aef25597a4ab480625b53c48cfe80", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: a99aef25597a4ab480625b53c48cfe80 Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-22159978 Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: def04335e57e48409a6943fa231d47c3 Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-AttachVolumeNegativeTest-22159978-project Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.732509 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'eb650451-50be-4714-b442-2a6cbcf96d6d'} Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:12:38.733337 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. Aug 24 10:12:38.734488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:12:38.735508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] Returning 404 to user: Instance eb650451-50be-4714-b442-2a6cbcf96d6d could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:12:38.735508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-010fa1f6-5533-4e73-a156-420558506db9 tempest-AttachVolumeNegativeTest-22159978 tempest-AttachVolumeNegativeTest-22159978-project] 10.222.0.16 "GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d" status: 404 len: 111 microversion: 2.1 time: 0.035946 Aug 24 10:12:38.735508 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1196/2415] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:12:38 2022] GET /compute/v2.1/servers/eb650451-50be-4714-b442-2a6cbcf96d6d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:13:01.514699 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:13:01.515245 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:13:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:14:28.376118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 43844. Aug 24 10:14:28.572959 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3d10ca03-28c5-48ec-af7a-ff6f65b9c065 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Action: 'create', calling method: .version_select at 0x7fa912d558b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-801133270", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6cz/bM1cPQMvk6F2wxOaZISe+2XPQJDVRf2JZKykX1Xu/3nkI/LIWC2h5igV9h7eGrJkqYjbtr5OJJ73opL8wb4eTDSs2ordxqDinFNDS6xI029R1W/9SQTSOhSp1e5w=="}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:14:28.589636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-3d10ca03-28c5-48ec-af7a-ff6f65b9c065 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for project e8f7d973a28745d0a1109ce56927b450. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:14:28.593895 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-3d10ca03-28c5-48ec-af7a-ff6f65b9c065 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for user 89351fa3299b41c5b543f0ccdf9f7527 and project e8f7d973a28745d0a1109ce56927b450. Resources: {'key_pairs'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:14:28.679613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3d10ca03-28c5-48ec-af7a-ff6f65b9c065 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.317260 Aug 24 10:14:28.682339 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1220/2416] 10.222.0.16 () {60 vars in 1159 bytes} [Wed Aug 24 10:14:28 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:14:48.551175 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:14:48.551711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:14:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:14:50.131108 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:14:50.131766 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:14:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:14:51.025414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:14:51.026088 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:14:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:15:03.076671 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:15:03.077189 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:15:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:15:06.692423 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1358610473", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-801133270", "security_groups": [{"name": "tempest-secgroup-smoke-1627827074"}], "block_device_mapping_v2": [{"uuid": "70a3bb24-7bbe-428a-ad6d-385ed4037d02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0736146-9964-4147-83dd-083e20f97b7a"}]}} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:06.716940 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44030. Aug 24 10:15:06.900826 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.network.neutron [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] validate_networks() for [('a0736146-9964-4147-83dd-083e20f97b7a', None, None, None, None, None)] {{(pid=121142) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:15:07.365442 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Flavor limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:15:07.365867 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Image limits 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:15:07.366346 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Flavor pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:15:07.366757 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Image pref 0:0:0 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:15:07.367171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.virt.hardware [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121142) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:15:07.376868 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:07.377347 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:07.377855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:07.378583 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:07.379040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:07.379462 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:07.395679 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for project e8f7d973a28745d0a1109ce56927b450. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:15:07.399527 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.quota [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for user 89351fa3299b41c5b543f0ccdf9f7527 and project e8f7d973a28745d0a1109ce56927b450. Resources: {'instances', 'cores', 'ram'} {{(pid=121142) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:15:07.455116 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Going to run 1 instances... {{(pid=121142) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:15:07.457262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70a3bb24-7bbe-428a-ad6d-385ed4037d02',volume_size=None,volume_type=None)] {{(pid=121142) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:15:07.831098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3c0f6b9b-b011-459c-b981-f146a2d37c57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.145560 Aug 24 10:15:07.831843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1197/2417] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 10:15:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1147 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:15:07.839880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:07.840650 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=4 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:07.841288 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:07.845248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-2ae3738c-dc90-4009-a103-39e8b16b23e8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:07.846652 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-2ae3738c-dc90-4009-a103-39e8b16b23e8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:07.950247 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-2ae3738c-dc90-4009-a103-39e8b16b23e8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:07.957128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-2ae3738c-dc90-4009-a103-39e8b16b23e8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1094 microversion: 2.1 time: 0.118578 Aug 24 10:15:07.957675 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1221/2418] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:07 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1094 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:08.978441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e97c00c1-57a3-4a32-8ee2-746157aa6d1a tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:08.979089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e97c00c1-57a3-4a32-8ee2-746157aa6d1a tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:09.036066 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e97c00c1-57a3-4a32-8ee2-746157aa6d1a tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:09.042993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e97c00c1-57a3-4a32-8ee2-746157aa6d1a tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1094 microversion: 2.1 time: 0.068951 Aug 24 10:15:09.043531 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1198/2419] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:08 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:10.063368 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:10.064012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:10.071807 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:10.073810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:10.073810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:10.073810 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:10.074085 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:10.074301 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:10.134943 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:10.143263 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-486b56bf-d387-4928-a19d-ab80f78636af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1192 microversion: 2.1 time: 0.083231 Aug 24 10:15:10.143858 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1222/2420] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:10 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:11.163622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:11.164247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:11.171168 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:11.171683 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:11.172122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:11.172835 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:11.173272 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:11.174212 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:11.376334 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:11.385184 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0205b226-148a-48fd-88ae-efb98a254a9d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1278 microversion: 2.1 time: 0.225321 Aug 24 10:15:11.385750 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1199/2421] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:11 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1278 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:12.040174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a864dc28-4250-4051-b8dc-18f3cf1ab883", "tag": "3199b020-dee8-46d9-bd6f-b7e14686e1c4"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:12.049514 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.050073 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.050507 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.061188 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] Creating event network-changed:3199b020-dee8-46d9-bd6f-b7e14686e1c4 for instance a864dc28-4250-4051-b8dc-18f3cf1ab883 on hv-cinder-85032 Aug 24 10:15:12.064442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] [562c8b49-c42a-42f2-94d5-27fab452ecd0] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:15:12.405793 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:12.406392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:12.412620 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.413096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.413525 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.414209 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:12.414659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:12.415085 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:12.560790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:12.569484 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-48d1a50a-33a9-44c3-bf75-ad885c93fde3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.167599 Aug 24 10:15:12.570037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1200/2422] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:12 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:15:13.071349 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] [562c8b49-c42a-42f2-94d5-27fab452ecd0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44074. Aug 24 10:15:13.074598 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-714799bd-4918-4d48-a5ca-c44ff0bdcd5a req-07153f1f-1931-4f31-89f4-07a0851cf223 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.095334 Aug 24 10:15:13.075198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1223/2423] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:13.590246 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:13.590767 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:13.598336 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.598809 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.599237 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.599908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:13.600391 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:13.600811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:13.730361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:13.737978 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-ec8752b4-ff1e-4a9a-8164-b54bdc41f5bb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.151592 Aug 24 10:15:13.738534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1201/2424] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:13 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:14.759694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:14.760335 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:14.766473 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:14.766954 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:14.767896 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:14.768621 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:14.769082 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:14.769509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:14.897690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:14.905401 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c2ba4bd6-36b2-4643-9f53-d8ea8ac5dca4 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.150481 Aug 24 10:15:14.905949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1224/2425] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:14 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:15.926933 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:15.927548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:15.933961 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:15.934451 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:15.934894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:15.935604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:15.936065 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:15.936496 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:16.064580 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:16.072441 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8374c4db-35c6-4ec0-818d-cf712999bc4b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.149981 Aug 24 10:15:16.073002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1202/2426] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:15 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:17.092845 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:17.093454 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:17.100106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:17.100585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:17.101015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:17.101694 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:17.102141 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:17.102560 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:17.233200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:17.241439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4cde1a28-344d-4696-8a91-900f5b922ca3 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.152417 Aug 24 10:15:17.241994 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1225/2427] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:17 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:18.261776 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:18.262388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:18.264659 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:18.270005 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.270478 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.270908 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.271652 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:18.272104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:18.277819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:18.405598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:18.413627 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-175ff456-a71c-4a1d-8e7f-e228e5dece48 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.155699 Aug 24 10:15:18.414187 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1203/2428] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:18 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:19.433786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:19.434399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:19.436414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:19.441602 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:19.442250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:19.443050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:19.443910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:19.444362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:19.444795 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:19.573271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:19.581476 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5ecc7b8b-5890-4db3-8628-c08486848111 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.151487 Aug 24 10:15:19.582035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1226/2429] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:19 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:20.602622 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:20.603182 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:20.605016 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=8 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:15:20.610171 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.610647 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.611075 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.612598 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:20.613049 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:20.613470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:20.741240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:20.749037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6b6352ef-8017-4c7b-bfd2-7fa6c72ecb69 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.150295 Aug 24 10:15:20.749594 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1204/2430] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:20 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:21.769946 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:21.770566 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:21.776958 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.777442 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.777881 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.778565 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:21.779018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:21.779443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:21.911237 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:21.919077 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7a327f73-89d9-4160-b855-697520ae27c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.153558 Aug 24 10:15:21.919665 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1227/2431] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:21 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:22.945800 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:22.946417 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:22.953033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.960883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.960883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:22.960883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:22.960883 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:22.961295 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:23.087676 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:23.095321 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-da430306-1025-4515-acf5-0cfd3177e324 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.153321 Aug 24 10:15:23.095913 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1205/2432] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:22 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:24.114869 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:24.115478 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:24.121822 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.122293 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.122719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.123394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.123880 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.124299 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.249872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:24.257836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-6d5322bc-beaf-4720-8043-5537fe080c25 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.146819 Aug 24 10:15:24.258384 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1228/2433] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:24 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:24.824493 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-b9ae6cf3-9f8c-42f2-bad0-3057c26d556c req-07d65073-d632-4b7a-96ee-82e2f628ce81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a864dc28-4250-4051-b8dc-18f3cf1ab883", "name": "network-vif-plugged", "status": "completed", "tag": "3199b020-dee8-46d9-bd6f-b7e14686e1c4"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:24.833823 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b9ae6cf3-9f8c-42f2-bad0-3057c26d556c req-07d65073-d632-4b7a-96ee-82e2f628ce81 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:24.834293 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b9ae6cf3-9f8c-42f2-bad0-3057c26d556c req-07d65073-d632-4b7a-96ee-82e2f628ce81 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:24.834714 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-b9ae6cf3-9f8c-42f2-bad0-3057c26d556c req-07d65073-d632-4b7a-96ee-82e2f628ce81 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:24.845349 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-b9ae6cf3-9f8c-42f2-bad0-3057c26d556c req-07d65073-d632-4b7a-96ee-82e2f628ce81 service nova] Creating event network-vif-plugged:3199b020-dee8-46d9-bd6f-b7e14686e1c4 for instance a864dc28-4250-4051-b8dc-18f3cf1ab883 on hv-cinder-85032 Aug 24 10:15:24.853030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-b9ae6cf3-9f8c-42f2-bad0-3057c26d556c req-07d65073-d632-4b7a-96ee-82e2f628ce81 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090304 Aug 24 10:15:24.853645 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1206/2434] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:15:25.278343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:25.278980 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:25.285850 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.286362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.286801 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.287487 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:25.288098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:25.288399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:25.419816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:25.427417 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f38c3059-5958-416e-bb3d-19c3f516ef57 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.152922 Aug 24 10:15:25.428011 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1229/2435] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:25 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:15:26.454152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:26.454855 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:26.460972 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:26.461456 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:26.461897 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:26.462586 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:26.463046 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:26.463477 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:26.593839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:26.602233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8ccfd29e-9134-418a-a520-70a5a6348c10 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1266 microversion: 2.1 time: 0.152798 Aug 24 10:15:26.602794 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1207/2436] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:26 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:27.622969 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:27.623569 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:27.630443 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.633506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.633506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.633506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.633506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.633879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.760706 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:27.768635 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c3b65327-b27f-4679-9483-50220f727601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1453 microversion: 2.1 time: 0.149537 Aug 24 10:15:27.769199 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1230/2437] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:27 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:27.788420 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:15:27.789037 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:15:27.795325 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.795849 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.796288 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.796979 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:27.797439 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:27.797871 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:27.931054 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:15:27.934561 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c8fc3836-7e9f-4b34-87a3-78071be0bd64 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1453 microversion: 2.1 time: 0.149904 Aug 24 10:15:27.935120 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1208/2438] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:15:27 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:15:30.101370 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-e914568d-5197-493f-b8ee-75eed6024cc1 req-81a444a8-5c85-48c9-8903-d084b76129cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a864dc28-4250-4051-b8dc-18f3cf1ab883", "tag": "3199b020-dee8-46d9-bd6f-b7e14686e1c4"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:15:30.110595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-e914568d-5197-493f-b8ee-75eed6024cc1 req-81a444a8-5c85-48c9-8903-d084b76129cf service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:15:30.111062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-e914568d-5197-493f-b8ee-75eed6024cc1 req-81a444a8-5c85-48c9-8903-d084b76129cf service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:15:30.111562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-e914568d-5197-493f-b8ee-75eed6024cc1 req-81a444a8-5c85-48c9-8903-d084b76129cf service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:15:30.122488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-e914568d-5197-493f-b8ee-75eed6024cc1 req-81a444a8-5c85-48c9-8903-d084b76129cf service nova] Creating event network-changed:3199b020-dee8-46d9-bd6f-b7e14686e1c4 for instance a864dc28-4250-4051-b8dc-18f3cf1ab883 on hv-cinder-85032 Aug 24 10:15:30.127520 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-e914568d-5197-493f-b8ee-75eed6024cc1 req-81a444a8-5c85-48c9-8903-d084b76129cf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085533 Aug 24 10:15:30.128148 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1231/2439] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:17:57.168550 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:57.169304 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=60 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:57.173191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:57.173843 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:57.179540 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.181966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.181966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.181966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.182234 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.182604 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.208096 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:17:57.495563 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-0c97c821-e1e3-4db2-bcb1-d0e0ff727d94 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 204 len: 0 microversion: 2.1 time: 0.328844 Aug 24 10:17:57.496164 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1209/2440] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:17:57 2022] DELETE /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:17:57.502250 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:17:57.502838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=24 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:57.503576 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=52 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:17:57.507813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:57.508684 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:57.514609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.516095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.516095 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.516380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:57.516832 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:57.517244 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:57.652441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:57.660054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-5e4455ad-e327-4402-8203-36f8fae2b11b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1578 microversion: 2.1 time: 0.159518 Aug 24 10:17:57.660613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1232/2441] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:57 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:17:58.682019 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:58.682625 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:58.689048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.689528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.689956 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.690633 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:58.691078 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:58.691499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:58.825630 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:17:58.834104 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c051d2f3-71a1-4867-b7a3-9390f2e5204b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1578 microversion: 2.1 time: 0.156346 Aug 24 10:17:58.834685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1210/2442] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:58 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:17:59.862468 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:17:59.863028 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:17:59.873595 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44166. Aug 24 10:17:59.878992 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.879479 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.879967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:17:59.880655 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:17:59.881106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:17:59.881531 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.011137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:00.020074 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-402b3380-c806-4c87-8e68-c762d7ca6591 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1578 microversion: 2.1 time: 0.161552 Aug 24 10:18:00.025444 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1233/2443] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:17:59 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:00.437314 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-d559696b-4c3c-4d21-9606-121270e7aca0 req-53bc3d2c-1c09-4d8a-89d9-d4f56fe0fcf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a864dc28-4250-4051-b8dc-18f3cf1ab883", "name": "network-vif-deleted", "tag": "3199b020-dee8-46d9-bd6f-b7e14686e1c4"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:00.450717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d559696b-4c3c-4d21-9606-121270e7aca0 req-53bc3d2c-1c09-4d8a-89d9-d4f56fe0fcf3 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:00.450717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d559696b-4c3c-4d21-9606-121270e7aca0 req-53bc3d2c-1c09-4d8a-89d9-d4f56fe0fcf3 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:00.450717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-d559696b-4c3c-4d21-9606-121270e7aca0 req-53bc3d2c-1c09-4d8a-89d9-d4f56fe0fcf3 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:00.460359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-d559696b-4c3c-4d21-9606-121270e7aca0 req-53bc3d2c-1c09-4d8a-89d9-d4f56fe0fcf3 service nova] Creating event network-vif-deleted:3199b020-dee8-46d9-bd6f-b7e14686e1c4 for instance a864dc28-4250-4051-b8dc-18f3cf1ab883 on hv-cinder-85032 Aug 24 10:18:00.466150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-d559696b-4c3c-4d21-9606-121270e7aca0 req-53bc3d2c-1c09-4d8a-89d9-d4f56fe0fcf3 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033253 Aug 24 10:18:00.466736 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1211/2444] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:01.042628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:01.043221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:01.049553 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.050036 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.050470 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.051153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:01.051703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:01.052042 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:01.127927 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:01.135840 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a6918bf7-f59c-49b2-8f70-de9c87f793f2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 200 len: 1225 microversion: 2.1 time: 0.097645 Aug 24 10:18:01.136498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1234/2445] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:01 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:02.157135 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:02.157842 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:02.164032 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.165077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.165517 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.166204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.166663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.167100 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.179980 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] HTTP exception thrown: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Request method failure captured: Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 HTTP/1.1 Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfn-4jHLbWp774PGV1MSo5gRbBKHh5UhS4PPdDa-6zV0qHSw4MYYC_4quU20Bk-FcQi0KuT1LFf0lr90SZIaD56ZKsRCuJUtiXgXsqA9QZ9l77d-IKavGSGjbstPH-hoPzO32QozeXVQogeHkgdl2aJenu8vLPrSqpBG0Pjb8ygprOc Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:18:02.181593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f7d973a28745d0a1109ce56927b450", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-TestVolumeBootPattern-302547767 Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: 89351fa3299b41c5b543f0ccdf9f7527 Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:18:02.183030 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'a864dc28-4250-4051-b8dc-18f3cf1ab883'} Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:18:02.183875 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:18:02.185365 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:18:02.186681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Returning 404 to user: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:18:02.186681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3a3254da-9bac-4fa6-a38d-34b55af4a705 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 404 len: 111 microversion: 2.1 time: 0.030491 Aug 24 10:18:02.186681 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1212/2446] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:02 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:18:02.230359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2006090628", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-801133270", "security_groups": [{"name": "tempest-secgroup-smoke-1627827074"}], "block_device_mapping_v2": [{"uuid": "70a3bb24-7bbe-428a-ad6d-385ed4037d02", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0736146-9964-4147-83dd-083e20f97b7a"}]}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:02.344022 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] validate_networks() for [('a0736146-9964-4147-83dd-083e20f97b7a', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:18:02.814191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:18:02.814614 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:18:02.815080 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:18:02.815482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:18:02.815916 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:18:02.825227 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.825734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.826231 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.826988 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:02.827441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:02.827892 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:02.844611 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for project e8f7d973a28745d0a1109ce56927b450. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:18:02.848816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for user 89351fa3299b41c5b543f0ccdf9f7527 and project e8f7d973a28745d0a1109ce56927b450. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:18:02.904955 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:18:02.907118 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='70a3bb24-7bbe-428a-ad6d-385ed4037d02',volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:18:03.312153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [0dfeb33a-421d-40c9-998d-9836b4329ce1] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:18:04.318951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [0dfeb33a-421d-40c9-998d-9836b4329ce1] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44194. Aug 24 10:18:04.323522 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d01f0ba7-0961-414b-9564-89efb0a03702 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.097722 Aug 24 10:18:04.324202 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1235/2447] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 10:18:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 2099 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:18:04.335050 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-6e258c7b-c484-4a85-97af-4e039dcb99bd tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:04.335816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-6e258c7b-c484-4a85-97af-4e039dcb99bd tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:04.393245 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-6e258c7b-c484-4a85-97af-4e039dcb99bd tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:04.400271 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-6e258c7b-c484-4a85-97af-4e039dcb99bd tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1094 microversion: 2.1 time: 0.069145 Aug 24 10:18:04.400837 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1213/2448] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:04 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:05.420809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-de096d67-dd24-4059-b0a1-177e14960601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:05.421455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-de096d67-dd24-4059-b0a1-177e14960601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:05.474407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-de096d67-dd24-4059-b0a1-177e14960601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:05.481712 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-de096d67-dd24-4059-b0a1-177e14960601 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1094 microversion: 2.1 time: 0.065246 Aug 24 10:18:05.482356 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1236/2449] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:05 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:06.501848 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-b28ab1fb-9efb-4f89-a4a3-691dbbab8106 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:06.502495 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-b28ab1fb-9efb-4f89-a4a3-691dbbab8106 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:06.555905 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-b28ab1fb-9efb-4f89-a4a3-691dbbab8106 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:06.562922 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-b28ab1fb-9efb-4f89-a4a3-691dbbab8106 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1094 microversion: 2.1 time: 0.064911 Aug 24 10:18:06.563488 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1214/2450] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:06 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1094 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:07.584012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f4c0dbff-17ae-4c9f-96b8-93a20fd748b8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:07.584547 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f4c0dbff-17ae-4c9f-96b8-93a20fd748b8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:07.637054 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f4c0dbff-17ae-4c9f-96b8-93a20fd748b8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:07.643796 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f4c0dbff-17ae-4c9f-96b8-93a20fd748b8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1094 microversion: 2.1 time: 0.063751 Aug 24 10:18:07.644362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1237/2451] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:07 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:08.559819 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:18:08.560328 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:18:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:18:08.664226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:08.664840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:08.670994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.671467 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.671936 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.672617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:08.673103 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:08.673529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:08.732660 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:08.740166 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7655c169-436b-4d43-b980-16ad801d87ff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1144 microversion: 2.1 time: 0.079738 Aug 24 10:18:08.740722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1215/2452] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:08 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1144 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:09.760241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:09.760839 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:09.767191 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.767705 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.768143 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.768828 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:09.769282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:09.769709 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:09.829931 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:09.838175 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-cc39f1d7-865e-474e-b167-ee12f3a0bfa0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1136 microversion: 2.1 time: 0.082566 Aug 24 10:18:09.838739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1238/2453] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:09 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:10.139447 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:18:10.140036 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:18:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:18:10.858543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:10.859155 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:10.865858 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.866345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.866777 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.868093 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:10.868547 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:10.869002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:10.941513 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:10.949233 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-9576d878-1e4f-4ad0-afda-ed9b64654009 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1210 microversion: 2.1 time: 0.094513 Aug 24 10:18:10.949796 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1216/2454] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:10 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:11.970058 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:11.970666 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:11.977649 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.978157 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.978586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:11.979455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:11.979941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:11.980362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.073163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-c6a22a0d-c8e1-4ee7-8fe0-f417e94e3a32 req-41c27a79-0ed4-416c-8ad2-c8eeb43fe8c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b540c339-c1de-4c7c-aa85-0a7c46986c0b", "tag": "8eb739ad-5dd1-4501-9347-0464586463ca"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:12.084684 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c6a22a0d-c8e1-4ee7-8fe0-f417e94e3a32 req-41c27a79-0ed4-416c-8ad2-c8eeb43fe8c7 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:12.085502 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c6a22a0d-c8e1-4ee7-8fe0-f417e94e3a32 req-41c27a79-0ed4-416c-8ad2-c8eeb43fe8c7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:12.086703 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c6a22a0d-c8e1-4ee7-8fe0-f417e94e3a32 req-41c27a79-0ed4-416c-8ad2-c8eeb43fe8c7 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:12.098087 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-c6a22a0d-c8e1-4ee7-8fe0-f417e94e3a32 req-41c27a79-0ed4-416c-8ad2-c8eeb43fe8c7 service nova] Creating event network-changed:8eb739ad-5dd1-4501-9347-0464586463ca for instance b540c339-c1de-4c7c-aa85-0a7c46986c0b on hv-cinder-85032 Aug 24 10:18:12.104150 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-c6a22a0d-c8e1-4ee7-8fe0-f417e94e3a32 req-41c27a79-0ed4-416c-8ad2-c8eeb43fe8c7 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035699 Aug 24 10:18:12.108584 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1217/2455] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:18:12.120664 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:12.129172 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-743aa27e-ab4e-48c3-90dc-9073b7d5b841 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.162978 Aug 24 10:18:12.131567 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1239/2456] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:11 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:13.150033 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:13.150754 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:13.156804 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.157286 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.157715 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.158390 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:13.158840 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:13.159262 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:13.289480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:13.296928 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a0bcc1ff-82af-4b89-96c7-e824134d25af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.151490 Aug 24 10:18:13.297489 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1218/2457] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:13 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:14.318192 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:14.318805 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:14.320640 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:14.325967 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.326448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.326887 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.327604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:14.328062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:14.328490 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:14.455506 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:14.463541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-f9fd5c00-247b-4686-81e6-c59060652410 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.149183 Aug 24 10:18:14.464114 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1240/2458] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:14 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:15.484969 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:15.485581 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:15.492790 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.493280 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.493717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.494409 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:15.494927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:15.495361 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:15.625762 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:15.633697 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-a26bb8b8-7f3a-42d2-b385-3629d75fc6d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.152526 Aug 24 10:18:15.634309 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1219/2459] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:15 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:16.654467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:16.655072 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:16.661619 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.662098 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.662530 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.663205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:16.663685 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:16.664703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:16.795625 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:16.803213 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-842f5a65-d278-4a80-bcfe-30ee7534ea32 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.152603 Aug 24 10:18:16.803792 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1241/2460] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:16 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:17.824162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:17.824782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:17.827169 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=4 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:17.831946 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.832433 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.832870 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.833558 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:17.834015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:17.834443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:17.965768 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:17.973764 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3f259417-a204-495c-9db7-3cbe206a51a2 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.153772 Aug 24 10:18:17.974332 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1220/2461] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:17 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:18.994018 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:18.994628 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:18.996534 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=10 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:19.001683 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.002159 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.002590 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.003266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:19.003748 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:19.007164 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:19.133651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:19.141262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-b86f74a1-120b-40ad-b7d1-29e31b4cf67d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.151077 Aug 24 10:18:19.141813 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1242/2462] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:18 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:20.162088 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:20.162699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:20.169740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.170220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.170664 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.171345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:20.171839 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:20.172270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:20.300095 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:20.307737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c1f03d14-b371-4805-a237-68ff4a9141e1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.149512 Aug 24 10:18:20.308313 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1221/2463] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:20 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:21.328413 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:21.329266 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:21.336464 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.340173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.340173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.340173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:21.340173 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:21.340496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:21.468102 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:21.476127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-02a0bc8e-2c38-48d7-8b44-f9120a628128 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.151640 Aug 24 10:18:21.476689 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1243/2464] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:21 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:22.496903 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:22.497548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:22.503985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.504470 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.504909 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.505593 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:22.506047 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:22.506474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:22.640722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:22.648260 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-37669ab7-2ac2-4ed4-b52e-1babfd0631c1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.155219 Aug 24 10:18:22.648820 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1222/2465] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:22 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:23.506194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b540c339-c1de-4c7c-aa85-0a7c46986c0b", "name": "network-vif-plugged", "status": "completed", "tag": "8eb739ad-5dd1-4501-9347-0464586463ca"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:23.516920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.517394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.517824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.528467 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] Creating event network-vif-plugged:8eb739ad-5dd1-4501-9347-0464586463ca for instance b540c339-c1de-4c7c-aa85-0a7c46986c0b on hv-cinder-85032 Aug 24 10:18:23.531968 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] [562c8b49-c42a-42f2-94d5-27fab452ecd0] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:18:23.669101 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:23.669722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:23.676063 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.676548 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.676992 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.677711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:23.678170 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:23.678603 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:23.808828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:23.816534 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-1dd82970-05de-4c3c-8fac-dddcdbbd34bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.151327 Aug 24 10:18:23.817125 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1223/2466] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:23 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:24.539362 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] [562c8b49-c42a-42f2-94d5-27fab452ecd0] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44268. Aug 24 10:18:24.542563 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-44e65e00-6143-46a3-ad70-2ecfcaad5670 req-4a7f4e51-461d-4088-9ce1-becd99b9ffaf service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.040298 Aug 24 10:18:24.543156 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1244/2467] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:18:24.837529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:24.838129 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:24.844615 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:24.845090 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:24.845521 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:24.846198 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:24.846655 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:24.847077 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:25.038815 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:25.046446 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-123a6724-d323-4e7e-8fa4-0af5f12364a6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.213361 Aug 24 10:18:25.046994 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1224/2468] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:24 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:26.068282 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:26.069019 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:26.075113 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.075620 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.076064 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.076753 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:26.077210 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:26.077643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:26.209660 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:26.217136 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7d1b7229-78ff-4f1b-9851-5421749232d8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1266 microversion: 2.1 time: 0.153660 Aug 24 10:18:26.217690 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1245/2469] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:26 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:27.237589 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:27.238239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:27.244474 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.244952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.245387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.246086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.246523 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.246993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.250824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:27.385500 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:27.393387 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d9a61cee-5c80-4e13-aeb0-5a035b9834dc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1452 microversion: 2.1 time: 0.159772 Aug 24 10:18:27.393966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1225/2470] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:27 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:18:27.413076 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:18:27.413719 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:18:27.420158 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.420646 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.421087 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.421778 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:27.422235 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:27.422671 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:27.551105 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:18:27.559246 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c389e73b-7de9-4dad-b4a3-33d43d03a70c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1452 microversion: 2.1 time: 0.150045 Aug 24 10:18:27.559836 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1246/2471] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:18:27 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:18:29.371359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-6aed7336-93c0-4037-beba-52c24cdc4b5b req-81eed8d0-9da7-4636-bf41-86b1cd0a3d3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b540c339-c1de-4c7c-aa85-0a7c46986c0b", "tag": "8eb739ad-5dd1-4501-9347-0464586463ca"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:18:29.376617 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:18:29.381699 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6aed7336-93c0-4037-beba-52c24cdc4b5b req-81eed8d0-9da7-4636-bf41-86b1cd0a3d3d service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:18:29.382814 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6aed7336-93c0-4037-beba-52c24cdc4b5b req-81eed8d0-9da7-4636-bf41-86b1cd0a3d3d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:18:29.383257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-6aed7336-93c0-4037-beba-52c24cdc4b5b req-81eed8d0-9da7-4636-bf41-86b1cd0a3d3d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:18:29.394411 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-6aed7336-93c0-4037-beba-52c24cdc4b5b req-81eed8d0-9da7-4636-bf41-86b1cd0a3d3d service nova] Creating event network-changed:8eb739ad-5dd1-4501-9347-0464586463ca for instance b540c339-c1de-4c7c-aa85-0a7c46986c0b on hv-cinder-85032 Aug 24 10:18:29.399560 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-6aed7336-93c0-4037-beba-52c24cdc4b5b req-81eed8d0-9da7-4636-bf41-86b1cd0a3d3d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032428 Aug 24 10:18:29.400253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1226/2472] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:19:41.526894 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:19:41.527426 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:19:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:20:57.196122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:57.196907 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=70 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:57.201375 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-784045530", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-801133270", "security_groups": [{"name": "tempest-secgroup-smoke-1627827074"}], "block_device_mapping_v2": [{"uuid": "6dadc872-2c1f-438d-a989-444c36e455ba", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a0736146-9964-4147-83dd-083e20f97b7a"}]}} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:20:57.362312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.network.neutron [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] validate_networks() for [('a0736146-9964-4147-83dd-083e20f97b7a', None, None, None, None, None)] {{(pid=121141) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 24 10:20:57.725568 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Flavor limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 24 10:20:57.725990 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Image limits 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 24 10:20:57.726457 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Flavor pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 24 10:20:57.726861 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Image pref 0:0:0 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 24 10:20:57.727267 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.virt.hardware [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121141) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 24 10:20:57.735872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.736354 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.736786 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.737502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:57.737949 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:57.738374 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:57.754853 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for project e8f7d973a28745d0a1109ce56927b450. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 24 10:20:57.758687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.quota [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Getting quotas for user 89351fa3299b41c5b543f0ccdf9f7527 and project e8f7d973a28745d0a1109ce56927b450. Resources: {'instances', 'cores', 'ram'} {{(pid=121141) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 24 10:20:57.813859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Going to run 1 instances... {{(pid=121141) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 24 10:20:57.816014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6dadc872-2c1f-438d-a989-444c36e455ba',volume_size=None,volume_type=None)] {{(pid=121141) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 24 10:20:58.283648 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7f32339a-6c81-4be4-86c8-cd560c938024 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.089141 Aug 24 10:20:58.284343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1247/2473] 10.222.0.16 () {60 vars in 1147 bytes} [Wed Aug 24 10:20:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1090 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 24 10:20:58.293688 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:20:58.294207 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=7 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:20:58.299015 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e5d89a30-4ac7-4b1e-a734-34afe33e7fe6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:58.299725 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e5d89a30-4ac7-4b1e-a734-34afe33e7fe6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:58.403542 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-e5d89a30-4ac7-4b1e-a734-34afe33e7fe6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:58.410460 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e5d89a30-4ac7-4b1e-a734-34afe33e7fe6 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1093 microversion: 2.1 time: 0.119293 Aug 24 10:20:58.411083 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1227/2474] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:58 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1093 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:20:59.430651 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:20:59.431275 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:20:59.438636 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.439122 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.439559 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.440311 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:20:59.440769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:20:59.441200 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:20:59.501834 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:20:59.509533 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4350ce95-d547-4677-ba6c-d0a76bb5fad0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1143 microversion: 2.1 time: 0.083234 Aug 24 10:20:59.510090 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1248/2475] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:20:59 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:00.530443 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:00.531057 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:00.538465 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.538955 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.539389 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.540213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:00.540667 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:00.541099 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:00.547949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] [61e7e128-e1df-4c56-b030-67c623a938ab] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44452. Aug 24 10:21:00.641570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:00.649444 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-7a4d94bb-1741-4c46-a4a8-0fa5c0fd6029 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1209 microversion: 2.1 time: 0.123497 Aug 24 10:21:00.650007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1228/2476] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:00 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1209 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:01.670083 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:01.670728 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:01.676951 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:01.677436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:01.677873 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:01.678609 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:01.679160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:01.679488 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:01.820436 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:01.829020 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-a581c70b-4a21-4c94-90ed-53c3585ee78e tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1277 microversion: 2.1 time: 0.162765 Aug 24 10:21:01.829586 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1249/2477] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:01 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:02.100226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-8b80a05e-bc76-4d25-8a82-bd8d8910e47d req-26456f65-16e7-428e-afb6-24bb1193c80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf959a1a-8eed-4cc2-9160-9ca336a46b97", "tag": "90f1fdbc-f5f7-4801-b53f-c0408f26482e"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:02.109811 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-8b80a05e-bc76-4d25-8a82-bd8d8910e47d req-26456f65-16e7-428e-afb6-24bb1193c80f service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.110293 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-8b80a05e-bc76-4d25-8a82-bd8d8910e47d req-26456f65-16e7-428e-afb6-24bb1193c80f service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.110755 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-8b80a05e-bc76-4d25-8a82-bd8d8910e47d req-26456f65-16e7-428e-afb6-24bb1193c80f service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.121637 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-8b80a05e-bc76-4d25-8a82-bd8d8910e47d req-26456f65-16e7-428e-afb6-24bb1193c80f service nova] Creating event network-changed:90f1fdbc-f5f7-4801-b53f-c0408f26482e for instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 on hv-cinder-85032 Aug 24 10:21:02.128122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-8b80a05e-bc76-4d25-8a82-bd8d8910e47d req-26456f65-16e7-428e-afb6-24bb1193c80f service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086418 Aug 24 10:21:02.128122 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1229/2478] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:02.849195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:02.850097 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:02.856557 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.857043 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.857484 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.858174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:02.858631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:02.859059 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:02.990174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:02.997843 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-25fb7eb9-135c-463a-803e-92287a67d65b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.152572 Aug 24 10:21:02.998407 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1250/2479] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:02 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 24 10:21:04.019810 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:04.020529 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:04.026574 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.027059 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.027492 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.028256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:04.028710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:04.029131 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:04.161827 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:04.169436 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-81b8f624-8927-4228-8a70-3908070f2bc8 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.154373 Aug 24 10:21:04.170002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1230/2480] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:04 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:05.189762 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:05.190376 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:05.196897 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:05.197380 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:05.197816 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:05.198499 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:05.199485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:05.199964 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:05.326791 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:05.334631 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-99fa3807-971e-4591-87d2-efd0fec6066d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.148768 Aug 24 10:21:05.335201 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1251/2481] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:05 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:06.355316 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:06.355945 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:06.362224 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:06.366248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:06.366248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:06.366248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:06.366248 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:06.366605 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:06.494143 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:06.502345 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-cd0997ea-010f-4b30-8ed3-c219517118cb tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.150970 Aug 24 10:21:06.502894 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1231/2482] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:06 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:07.523300 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:07.523847 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:07.530780 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:07.531262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:07.531739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:07.532432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:07.532886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:07.533312 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:07.663703 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:07.671498 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-c54371ec-5823-47b8-ad39-29d94378c81c tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.152232 Aug 24 10:21:07.672089 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1252/2483] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:07 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:08.693007 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:08.693608 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:08.696092 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell0:SELECT=2 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:08.701422 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:08.701899 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:08.702335 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:08.703003 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:08.703452 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:08.703901 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:08.831658 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:08.839213 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-f6a882c7-a771-4b71-b999-022b3799b681 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.150126 Aug 24 10:21:08.839960 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1232/2484] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:08 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:09.860788 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:09.861562 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:09.863477 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=2 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:09.864233 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell0:SELECT=6 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:21:09.869414 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.874604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.874604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:09.874604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:09.874604 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:09.875044 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:10.002419 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:10.010324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-3c7083af-cc64-4ede-b28f-2939ecbc9bff tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.154001 Aug 24 10:21:10.010879 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1253/2485] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:09 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:11.030789 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:11.031406 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:11.037711 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:11.038191 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:11.038628 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:11.039315 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:11.039817 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:11.040292 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:11.173912 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:11.181360 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-d2733862-ed43-47de-a4f2-87e176b343f1 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.154937 Aug 24 10:21:11.182021 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1233/2486] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:11 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:12.202322 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:12.202945 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:12.209248 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:12.209723 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:12.210153 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:12.210824 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:12.211271 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:12.211721 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:12.341225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:12.348849 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-bb62326d-d57e-419f-b404-3c88b1163b58 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.150933 Aug 24 10:21:12.349405 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1254/2487] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:12 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:12.470952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-c79257c9-e7ab-4668-90ab-8cdab45a3990 req-a400753b-c12f-4245-994e-159b50088209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf959a1a-8eed-4cc2-9160-9ca336a46b97", "name": "network-vif-plugged", "status": "completed", "tag": "90f1fdbc-f5f7-4801-b53f-c0408f26482e"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:12.480588 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c79257c9-e7ab-4668-90ab-8cdab45a3990 req-a400753b-c12f-4245-994e-159b50088209 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:12.481071 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c79257c9-e7ab-4668-90ab-8cdab45a3990 req-a400753b-c12f-4245-994e-159b50088209 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:12.481503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-c79257c9-e7ab-4668-90ab-8cdab45a3990 req-a400753b-c12f-4245-994e-159b50088209 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:12.492343 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-c79257c9-e7ab-4668-90ab-8cdab45a3990 req-a400753b-c12f-4245-994e-159b50088209 service nova] Creating event network-vif-plugged:90f1fdbc-f5f7-4801-b53f-c0408f26482e for instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 on hv-cinder-85032 Aug 24 10:21:12.499110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-c79257c9-e7ab-4668-90ab-8cdab45a3990 req-a400753b-c12f-4245-994e-159b50088209 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085628 Aug 24 10:21:12.499717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1234/2488] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:13.369722 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:13.370343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:13.377399 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.377886 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.378323 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:13.379012 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:13.379472 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:13.379929 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:13.513427 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:13.521140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-4cdd67ae-80ce-4196-bcce-d121350d7a09 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.155263 Aug 24 10:21:13.521698 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1255/2489] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:13 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:14.542432 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:14.543142 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:14.549247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:14.549717 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:14.550152 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:14.550824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:14.551270 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:14.551722 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:14.684086 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:14.698098 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-c4c8d86b-5595-421f-b003-3d2de1f57f04 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1265 microversion: 2.1 time: 0.160249 Aug 24 10:21:14.698654 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1235/2490] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:14 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:15.719099 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:15.719732 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:15.726263 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.726739 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.727174 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:15.727872 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.728321 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.728742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:15.854820 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:15.862363 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-ceb07023-de20-4f0b-9004-54c8f065be8d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1452 microversion: 2.1 time: 0.147728 Aug 24 10:21:15.862920 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1256/2491] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:15 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:15.882106 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:21:15.882710 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:21:15.889677 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.890148 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.890576 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:15.891249 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:15.891730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:15.892151 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:16.019331 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:21:16.026993 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-49cc630e-8dbd-4b79-aef9-63dc95f5ca01 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1452 microversion: 2.1 time: 0.148630 Aug 24 10:21:16.027552 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1236/2492] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:21:15 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1452 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:21:18.179736 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-f3dc2698-57ff-462d-8575-5f708adaa63d req-06ef6a5c-150a-4aa1-a774-c588ee9e9b97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf959a1a-8eed-4cc2-9160-9ca336a46b97", "tag": "90f1fdbc-f5f7-4801-b53f-c0408f26482e"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:21:18.189496 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-f3dc2698-57ff-462d-8575-5f708adaa63d req-06ef6a5c-150a-4aa1-a774-c588ee9e9b97 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:21:18.190035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-f3dc2698-57ff-462d-8575-5f708adaa63d req-06ef6a5c-150a-4aa1-a774-c588ee9e9b97 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:21:18.190527 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-f3dc2698-57ff-462d-8575-5f708adaa63d req-06ef6a5c-150a-4aa1-a774-c588ee9e9b97 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:21:18.202106 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-f3dc2698-57ff-462d-8575-5f708adaa63d req-06ef6a5c-150a-4aa1-a774-c588ee9e9b97 service nova] Creating event network-changed:90f1fdbc-f5f7-4801-b53f-c0408f26482e for instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 on hv-cinder-85032 Aug 24 10:21:18.207269 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-f3dc2698-57ff-462d-8575-5f708adaa63d req-06ef6a5c-150a-4aa1-a774-c588ee9e9b97 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079962 Aug 24 10:21:18.208035 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1257/2493] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:21:28.568220 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:21:28.568740 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:21:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:21:30.147596 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:21:30.148244 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:21:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:23:01.535186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:23:01.535790 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:23:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:23:08.002741 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_api:SELECT=23 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:08.006253 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG dbcounter [-] [121142] Writing DB stats nova_cell1:SELECT=46 {{(pid=121142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:08.006402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] AMQP server on 10.222.0.16:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 24 10:23:08.006402 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:08.012514 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:08.017941 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG dbcounter [-] [121141] Writing DB stats nova_cell1:SELECT=58 {{(pid=121141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 10:23:08.018082 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:08.018186 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [req-eca765d6-a8dd-4254-91c3-74d5dabc2cb0 req-ad2edcd4-eb67-4b06-8e10-7fc24a9c888b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf959a1a-8eed-4cc2-9160-9ca336a46b97", "tag": "90f1fdbc-f5f7-4801-b53f-c0408f26482e"}]} {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:08.021570 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.022330 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.022781 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.023480 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.023962 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.024388 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.034542 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-eca765d6-a8dd-4254-91c3-74d5dabc2cb0 req-ad2edcd4-eb67-4b06-8e10-7fc24a9c888b service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.035026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-eca765d6-a8dd-4254-91c3-74d5dabc2cb0 req-ad2edcd4-eb67-4b06-8e10-7fc24a9c888b service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.035463 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [req-eca765d6-a8dd-4254-91c3-74d5dabc2cb0 req-ad2edcd4-eb67-4b06-8e10-7fc24a9c888b service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.046359 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.compute.server_external_events [req-eca765d6-a8dd-4254-91c3-74d5dabc2cb0 req-ad2edcd4-eb67-4b06-8e10-7fc24a9c888b service nova] Creating event network-changed:90f1fdbc-f5f7-4801-b53f-c0408f26482e for instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 on hv-cinder-85032 Aug 24 10:23:08.052216 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Going to try to terminate instance {{(pid=121142) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:08.052851 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [req-eca765d6-a8dd-4254-91c3-74d5dabc2cb0 req-ad2edcd4-eb67-4b06-8e10-7fc24a9c888b service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049383 Aug 24 10:23:08.053944 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1258/2494] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:08.337040 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3eb82180-5ddb-45ed-9d4a-8056102cca1d tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "DELETE /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 204 len: 0 microversion: 2.1 time: 0.335939 Aug 24 10:23:08.340943 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1237/2495] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:07 2022] DELETE /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:08.347502 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:08.348262 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:08.355908 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.356509 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.356904 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.357663 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:08.358137 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:08.358543 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:08.499711 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:08.508194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-7fcbd0e4-c51c-43b2-bfd4-96e2a7b242af tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1576 microversion: 2.1 time: 0.165521 Aug 24 10:23:08.508751 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1259/2496] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:08 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:09.529689 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:09.530392 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:09.537035 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.537528 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.537966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.538663 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:09.539117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:09.539543 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:09.769004 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:09.776685 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-92c0a933-8ca0-4ebb-ad2c-af6e8bf66175 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1576 microversion: 2.1 time: 0.251330 Aug 24 10:23:09.777247 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1238/2497] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:09 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1576 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:10.798026 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:10.798642 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:10.806932 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.807421 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.807930 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.808641 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.809093 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.809521 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.867902 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] [de07ec1c-e55d-4ca6-8559-411be7a89477] Reconnected to AMQP server on 10.222.0.16:5672 via [amqp] client with port 44556. Aug 24 10:23:10.882702 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:10.884773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-ab0e7219-6e4e-4674-a867-ffd98e381c68 req-f77a9659-ce08-49e7-b931-35f456740a04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf959a1a-8eed-4cc2-9160-9ca336a46b97", "name": "network-vif-deleted", "tag": "90f1fdbc-f5f7-4801-b53f-c0408f26482e"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:10.890485 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-fe307e1a-124d-4b32-8f3a-ce4856d5d316 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1390 microversion: 2.1 time: 0.096366 Aug 24 10:23:10.891057 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1260/2498] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:10 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:10.892723 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-ab0e7219-6e4e-4674-a867-ffd98e381c68 req-f77a9659-ce08-49e7-b931-35f456740a04 service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:10.893222 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-ab0e7219-6e4e-4674-a867-ffd98e381c68 req-f77a9659-ce08-49e7-b931-35f456740a04 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:10.893644 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-ab0e7219-6e4e-4674-a867-ffd98e381c68 req-f77a9659-ce08-49e7-b931-35f456740a04 service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:10.904359 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-ab0e7219-6e4e-4674-a867-ffd98e381c68 req-f77a9659-ce08-49e7-b931-35f456740a04 service nova] Creating event network-vif-deleted:90f1fdbc-f5f7-4801-b53f-c0408f26482e for instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 on hv-cinder-85032 Aug 24 10:23:10.909866 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-ab0e7219-6e4e-4674-a867-ffd98e381c68 req-f77a9659-ce08-49e7-b931-35f456740a04 service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030489 Aug 24 10:23:10.910454 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1239/2499] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 24 10:23:11.041166 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:23:11.041425 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:23:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:23:11.911455 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:11.912189 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:11.918500 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.918984 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.919489 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.920131 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.920585 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.921014 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.951482 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:11.951996 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:11.952439 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:11.952882 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.objects.instance [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lazy-loading 'fault' on Instance uuid cf959a1a-8eed-4cc2-9160-9ca336a46b97 {{(pid=121141) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:11.993279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:12.000910 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-0ced7f23-4b44-4ab4-a0a2-abc8bf9ef93b tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 200 len: 1229 microversion: 2.1 time: 0.093292 Aug 24 10:23:12.001459 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1261/2500] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:11 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 1229 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:13.023009 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:13.023737 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: cf959a1a-8eed-4cc2-9160-9ca336a46b97] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:13.029828 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:13.030302 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:13.030730 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:13.031401 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:13.031879 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:13.032300 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:13.047892 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] HTTP exception thrown: Instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 could not be found. Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Request method failure captured: Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 HTTP/1.1 Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfn-4jHLbWp774PGV1MSo5gRbBKHh5UhS4PPdDa-6zV0qHSw4MYYC_4quU20Bk-FcQi0KuT1LFf0lr90SZIaD56ZKsRCuJUtiXgXsqA9QZ9l77d-IKavGSGjbstPH-hoPzO32QozeXVQogeHkgdl2aJenu8vLPrSqpBG0Pjb8ygprOc Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:23:13.049464 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f7d973a28745d0a1109ce56927b450", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: 89351fa3299b41c5b543f0ccdf9f7527 Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 could not be found. Aug 24 10:23:13.051034 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'cf959a1a-8eed-4cc2-9160-9ca336a46b97'} Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 could not be found. Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:13.051952 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 could not be found. Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 could not be found. Aug 24 10:23:13.053782 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:13.054974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Returning 404 to user: Instance cf959a1a-8eed-4cc2-9160-9ca336a46b97 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:13.054974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-bf6213b9-add5-4c7a-b2ee-a5ff7628f8fa tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97" status: 404 len: 111 microversion: 2.1 time: 0.032454 Aug 24 10:23:13.054974 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1240/2501] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:13 2022] GET /compute/v2.1/servers/cf959a1a-8eed-4cc2-9160-9ca336a46b97 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:16.459252 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:16.466103 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:16.466239 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-250de2ec-6339-481a-81a3-477ecf889a85 req-d0b4ec03-56c2-4945-a576-6ca4ac5ca4ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b540c339-c1de-4c7c-aa85-0a7c46986c0b", "tag": "8eb739ad-5dd1-4501-9347-0464586463ca"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:16.467428 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.468140 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.468757 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.469610 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.470279 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.470866 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.471506 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-250de2ec-6339-481a-81a3-477ecf889a85 req-d0b4ec03-56c2-4945-a576-6ca4ac5ca4ca service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.472013 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-250de2ec-6339-481a-81a3-477ecf889a85 req-d0b4ec03-56c2-4945-a576-6ca4ac5ca4ca service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.472440 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-250de2ec-6339-481a-81a3-477ecf889a85 req-d0b4ec03-56c2-4945-a576-6ca4ac5ca4ca service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.499643 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Going to try to terminate instance {{(pid=121141) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 24 10:23:16.643048 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-250de2ec-6339-481a-81a3-477ecf889a85 req-d0b4ec03-56c2-4945-a576-6ca4ac5ca4ca service nova] Creating event network-changed:8eb739ad-5dd1-4501-9347-0464586463ca for instance b540c339-c1de-4c7c-aa85-0a7c46986c0b on hv-cinder-85032 Aug 24 10:23:16.648185 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-250de2ec-6339-481a-81a3-477ecf889a85 req-d0b4ec03-56c2-4945-a576-6ca4ac5ca4ca service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.190356 Aug 24 10:23:16.649117 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1241/2502] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:16.823225 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-31a025f5-7bfa-4b67-894e-024d961364bc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "DELETE /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 204 len: 0 microversion: 2.1 time: 0.367747 Aug 24 10:23:16.824448 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1262/2503] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:16 2022] DELETE /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 24 10:23:16.835481 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:16.837824 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:16.844816 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.845538 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.846803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:16.847510 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:16.848369 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:16.848503 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:17.006163 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:17.015784 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-3ee2c7b1-3b6b-487a-8d30-7164df085047 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1577 microversion: 2.1 time: 0.186828 Aug 24 10:23:17.016545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1242/2504] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:16 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:18.038303 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:18.039015 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:18.046198 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.046687 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.047128 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.047864 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:18.048324 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:18.048754 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:18.180205 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:18.187948 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-d8b28d88-422b-4123-b3b6-d198613e3d13 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1577 microversion: 2.1 time: 0.153906 Aug 24 10:23:18.189742 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1263/2505] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:18 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:19.203566 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [req-0eed3905-8297-4b26-94cf-67bb352862cf req-942c8644-eca0-4e98-9892-0b2ed128a27d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b540c339-c1de-4c7c-aa85-0a7c46986c0b", "name": "network-vif-deleted", "tag": "8eb739ad-5dd1-4501-9347-0464586463ca"}]} {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 24 10:23:19.209195 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:19.209809 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:19.214927 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-0eed3905-8297-4b26-94cf-67bb352862cf req-942c8644-eca0-4e98-9892-0b2ed128a27d service nova] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.215774 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-0eed3905-8297-4b26-94cf-67bb352862cf req-942c8644-eca0-4e98-9892-0b2ed128a27d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.215966 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [req-0eed3905-8297-4b26-94cf-67bb352862cf req-942c8644-eca0-4e98-9892-0b2ed128a27d service nova] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.216124 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.216613 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.217050 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.217741 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:19.218194 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:19.218616 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:19.227011 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.compute.server_external_events [req-0eed3905-8297-4b26-94cf-67bb352862cf req-942c8644-eca0-4e98-9892-0b2ed128a27d service nova] Creating event network-vif-deleted:8eb739ad-5dd1-4501-9347-0464586463ca for instance b540c339-c1de-4c7c-aa85-0a7c46986c0b on hv-cinder-85032 Aug 24 10:23:19.232307 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [req-0eed3905-8297-4b26-94cf-67bb352862cf req-942c8644-eca0-4e98-9892-0b2ed128a27d service nova] 10.222.0.16 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Aug 24 10:23:19.232880 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1243/2506] 10.222.0.16 () {64 vars in 1317 bytes} [Wed Aug 24 10:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 24 10:23:19.284591 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.policy [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121141) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:19.293024 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-877c950d-944d-423a-adcc-e229469cdabc tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1390 microversion: 2.1 time: 0.087702 Aug 24 10:23:19.295859 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1264/2507] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:19 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:20.315204 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:20.315924 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:20.322638 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.323118 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.323551 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.324257 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.324706 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.325126 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.355373 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:20.355886 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:20.356326 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:20.356773 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.objects.instance [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lazy-loading 'fault' on Instance uuid b540c339-c1de-4c7c-aa85-0a7c46986c0b {{(pid=121142) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 24 10:23:20.402445 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.policy [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '89351fa3299b41c5b543f0ccdf9f7527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8f7d973a28745d0a1109ce56927b450', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121142) authorize /opt/stack/nova/nova/policy.py:199}} Aug 24 10:23:20.410195 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-98988a2e-7cac-41a8-8979-e49ce2d1e9ce tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 200 len: 1230 microversion: 2.1 time: 0.099642 Aug 24 10:23:20.410749 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1244/2508] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:20 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 1230 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 24 10:23:21.433241 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:21.433856 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: b540c339-c1de-4c7c-aa85-0a7c46986c0b] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:21.440270 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.440755 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.441203 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.441885 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:21.442343 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:21.442769 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:21.456127 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] HTTP exception thrown: Instance b540c339-c1de-4c7c-aa85-0a7c46986c0b could not be found. Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Request method failure captured: Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b HTTP/1.1 Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBfn-4jHLbWp774PGV1MSo5gRbBKHh5UhS4PPdDa-6zV0qHSw4MYYC_4quU20Bk-FcQi0KuT1LFf0lr90SZIaD56ZKsRCuJUtiXgXsqA9QZ9l77d-IKavGSGjbstPH-hoPzO32QozeXVQogeHkgdl2aJenu8vLPrSqpBG0Pjb8ygprOc Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:23:21.457734 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f7d973a28745d0a1109ce56927b450", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 89351fa3299b41c5b543f0ccdf9f7527 Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance b540c339-c1de-4c7c-aa85-0a7c46986c0b could not be found. Aug 24 10:23:21.459221 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'b540c339-c1de-4c7c-aa85-0a7c46986c0b'} Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b540c339-c1de-4c7c-aa85-0a7c46986c0b could not be found. Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:21.460160 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b540c339-c1de-4c7c-aa85-0a7c46986c0b could not be found. Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b540c339-c1de-4c7c-aa85-0a7c46986c0b could not be found. Aug 24 10:23:21.462062 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:21.464070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Returning 404 to user: Instance b540c339-c1de-4c7c-aa85-0a7c46986c0b could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:21.464070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-23ce082e-bbc9-4579-bd39-5e52a14e2064 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b" status: 404 len: 111 microversion: 2.1 time: 0.029734 Aug 24 10:23:21.464070 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1265/2509] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:21 2022] GET /compute/v2.1/servers/b540c339-c1de-4c7c-aa85-0a7c46986c0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:22.183733 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:22.184225 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.compute.api [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121142) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:22.190526 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.191002 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.191530 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.192240 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.192693 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.193110 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG oslo_concurrency.lockutils [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121142) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.205949 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.wsgi [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] HTTP exception thrown: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Request method failure captured: Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: request: DELETE /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 HTTP/1.1 Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept: application/json Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Accept-Encoding: identity Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Connection: close Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Length: 0 Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Content-Type: application/json Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Host: 10.222.0.16 Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Openstack-System-Scope: None Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Auth-Token: gAAAAABjBfn-4jHLbWp774PGV1MSo5gRbBKHh5UhS4PPdDa-6zV0qHSw4MYYC_4quU20Bk-FcQi0KuT1LFf0lr90SZIaD56ZKsRCuJUtiXgXsqA9QZ9l77d-IKavGSGjbstPH-hoPzO32QozeXVQogeHkgdl2aJenu8vLPrSqpBG0Pjb8ygprOc Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Id: None Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Domain-Name: None Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Identity-Status: Confirmed Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Is-Admin-Project: True Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Id: default Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Domain-Name: Default Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Project-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Role: member,reader Aug 24 10:23:22.207573 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Roles: member,reader Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f7d973a28745d0a1109ce56927b450", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-Tenant-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Id: default Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Domain-Name: Default Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Id: 89351fa3299b41c5b543f0ccdf9f7527 Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: X-User-Name: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: method: > Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: exception: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.209178 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: action_args: {'id': 'a864dc28-4250-4051-b8dc-18f3cf1ab883'} Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:22.209985 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.211226 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.212458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Returning 404 to user: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. {{(pid=121142) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:22.212458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-e94de59f-caef-4c83-8de0-49be92df5469 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "DELETE /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 404 len: 111 microversion: 2.1 time: 0.029766 Aug 24 10:23:22.212458 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1245/2510] 10.222.0.16 () {58 vars in 1239 bytes} [Wed Aug 24 10:23:22 2022] DELETE /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:22.217441 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '>' {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:22.218094 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.compute.api [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] [instance: a864dc28-4250-4051-b8dc-18f3cf1ab883] Fetching instance by UUID {{(pid=121141) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 24 10:23:22.224063 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.224541 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.224982 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.225934 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Acquiring lock "050771cb-a121-45a6-9902-2168b65adc50" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 24 10:23:22.226394 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 24 10:23:22.226838 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG oslo_concurrency.lockutils [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Lock "050771cb-a121-45a6-9902-2168b65adc50" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 24 10:23:22.240276 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.wsgi [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] HTTP exception thrown: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Request method failure captured: Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: request: GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 HTTP/1.1 Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept: application/json Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Accept-Encoding: identity Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Connection: close Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Length: 0 Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Content-Type: application/json Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Host: 10.222.0.16 Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Openstack-System-Scope: None Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: User-Agent: python-urllib3/1.26.11 Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Auth-Token: gAAAAABjBfn-4jHLbWp774PGV1MSo5gRbBKHh5UhS4PPdDa-6zV0qHSw4MYYC_4quU20Bk-FcQi0KuT1LFf0lr90SZIaD56ZKsRCuJUtiXgXsqA9QZ9l77d-IKavGSGjbstPH-hoPzO32QozeXVQogeHkgdl2aJenu8vLPrSqpBG0Pjb8ygprOc Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Id: None Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Domain-Name: None Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Identity-Status: Confirmed Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Is-Admin-Project: True Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Id: default Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Domain-Name: Default Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Project-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Role: member,reader Aug 24 10:23:22.241756 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Roles: member,reader Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/volume/v3/e8f7d973a28745d0a1109ce56927b450"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.16:8080/v1/AUTH_e8f7d973a28745d0a1109ce56927b450", "adminURL": "http://10.222.0.16:8080"}]}] Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Id: e8f7d973a28745d0a1109ce56927b450 Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-Tenant-Name: tempest-TestVolumeBootPattern-302547767 Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Id: default Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Domain-Name: Default Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Id: 89351fa3299b41c5b543f0ccdf9f7527 Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: X-User-Name: tempest-TestVolumeBootPattern-302547767-project Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: method: > Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: exception: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.243331 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: action_args: {'id': 'a864dc28-4250-4051-b8dc-18f3cf1ab883'} Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: {{(pid=121141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 24 10:23:22.244132 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. Aug 24 10:23:22.246291 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: ERROR nova.api.openstack.wsgi Aug 24 10:23:22.247814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: DEBUG nova.api.openstack.wsgi [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Returning 404 to user: Instance a864dc28-4250-4051-b8dc-18f3cf1ab883 could not be found. {{(pid=121141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 24 10:23:22.247814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO nova.api.openstack.requestlog [None req-02891ac1-7ba4-405e-b40b-324b97d243e0 tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883" status: 404 len: 111 microversion: 2.1 time: 0.029538 Aug 24 10:23:22.247814 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: [pid: 121141|app: 0|req: 1266/2511] 10.222.0.16 () {58 vars in 1236 bytes} [Wed Aug 24 10:23:22 2022] GET /compute/v2.1/servers/a864dc28-4250-4051-b8dc-18f3cf1ab883 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 24 10:23:23.730797 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: DEBUG nova.api.openstack.wsgi [None req-8a003ac9-90d6-4d00-9414-0dbe5078ebda tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] Calling method '.version_select at 0x7fa91b6bd430>' {{(pid=121142) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 24 10:23:23.841854 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO nova.api.openstack.requestlog [None req-8a003ac9-90d6-4d00-9414-0dbe5078ebda tempest-TestVolumeBootPattern-302547767 tempest-TestVolumeBootPattern-302547767-project] 10.222.0.16 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-801133270" status: 202 len: 0 microversion: 2.1 time: 0.115383 Aug 24 10:23:23.842339 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: [pid: 121142|app: 0|req: 1246/2512] 10.222.0.16 () {58 vars in 1260 bytes} [Wed Aug 24 10:23:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-801133270 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 24 10:24:48.576613 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:24:48.577256 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:24:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:26:21.544075 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:26:21.544747 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:26:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:26:30.157499 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:26:30.158162 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:26:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:26:31.049465 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:26:31.050053 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:26:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:28:08.584942 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:28:08.585545 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:28:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:28:23.095089 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:28:23.095803 dv-cinder-850321-5-iscsi devstack@n-api.service[121142]: Wed Aug 24 10:28:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 24 10:28:40.951432 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 24 10:28:40.952180 dv-cinder-850321-5-iscsi devstack@n-api.service[121141]: Wed Aug 24 10:28:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!